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SCIENCE VERSUS SENSATIONALISM IN 
PSYCHOLOGY FOR THE LAYMAN 


ROBERT J. LEWINSKI 
University of Iowa 
AND 


DANIEL D. FEDER 
University of Illinois 


ORE than any other science, psychology offers to the 
M layman a readily accessible field for the application 
of its findings. In the popular mind, psychology is 
not confined to laboratories and precise measurements, but is 
a key to the inner workings of the mind and personality which 
can be turned by all. Psychologists associated with recognized 
institutions of learning have been so concerned with the es- 
tablishment of psychology as a respectable science that they 
have almost totally neglected the widespread public interest 
which appertains to any subject so closely related to oneself. 
There has been but little effort on the part of most scientific 
psychologists to translate their findings into non-technical, 
everyday language. To be sure, not all that transpires in the 
psychological laboratory can and should be made available im- 
mediately to the public. However, many of the findings are 
of great interest, and, properly interpreted, can be applied 
toward more efficient living and greater personal happiness. 
Alert to the possibilities of capitalizing upon public interest 
are the ‘‘popular’’ and ‘‘practical’’ psychology magazines. 
Besides the stability and permanence of the printed word, they 
have also the advantage of nation-wide circulation. These 
magazines tend to emphasize the sensational, the morbid, and 
the usually forbidden areas of human behavior. 
The present study was made in an effort to gain a picture of 
the type of information which such magazines carry, as well as 
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of the men and women who write the articles. Eight issues of 
three such ‘‘psychological’’ magazines were analyzed for this 
purpose.* 

From the data in Table 1 it will be noted that the chief 









































TABLE 1 
Analysis of Subject-Matter of Articles in Popular Psychology 
Magazines 
Classification Number Per cent 
Abnormal Mental Conditions 22 21.2 
Love and Sex 15 14.4 
Suecess Formulae 11 10.6 
Personality 10 9.6 
Marital Affairs 9 8.7 
Psychoanalysis and Allied Phenomena ...................... 5 4.8 
Graphology, Fortune Telling and Allied Phe- 
nomena 5 4.8 
Telepathy and Allied Phenomena 0 ..cccccoccoon 5 4.8 
Suggestion and Hypnosis 4 3.8 
Physical Defects 3 2.9 
Child Culture 3 2.9 
Avocations 2 19 
**Colorology’’ 2 1.9 
Miscellaneous 8 7.7 








emphasis was on articles dealing with ‘‘abnormal mental con- 
ditions,’’ with articles on ‘‘love and sex’’ running a close 
second. Following in order of relative frequency are articles 
dealing with ‘‘success formulae,’’ ‘‘personality,’’ and ‘‘ marital 
affairs.’’ 

Table 2 summarizes the description of the contributing 
authors. It is noteworthy that only four of the contributing 
authors to these ‘‘psychology’’ magazines are affiliated with 
the American Psychological Association. Three are full mem- 
bers and one is an associate. Four more authors are listed 
as having Ph.D. degrees, yet for none was the field of study 
given nor the name of the degree-granting institution indi- 


1 Three issues each of The Modern Psychologist and Psychology, and 
two issues of Current Psychology and Psychoanalysis. 
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TABLE 2 


Status of Authors Who Contribute to Popular Psychology 
Magazines 





Members of A.P.A. 3 
Associate Members of A.P.A. 1 
Authors not in A.P.A., but recognized in the field 00. cccccccomn 3 
Number listed as having Ph.D. degree (no specifications) .......... 4 
1 
2 
6 








Number listed as having M.A. degree 
Number listed as having ‘‘Ps.D.’’ degree 
Number listed as ‘‘Dr.’’ with no specifications 














Number listed as physicians (M.D.) 9 
Number listed as psychologists (no A.P.A. affiliation) ................. 10 
Number about whom no information was given 26 
Miscellaneous* ll 








*The ‘‘miscellaneous’’ included authors, social workers, ‘‘colorolo- 
gists,’’ parole officers, etc. 


cated. Nine of the authors were listed as physicians, but this 
fact alone obviously does not qualify them as authorities in 
psychology. Eight of the nine M.D.’s are listed in the di- 
rectory of the American Medical Association. However, for 
six other ‘‘doctors’’ no listing in any professional area was 
found. Ten of the authors were described as ‘‘ psychologists’’ or 
‘*psychoanalysts,’’ yet not one of these persons was listed in 
the directory of American Psychological Association. Two of 
the authors held the Ps.D.—Doctor of Ps\chology—a degree 
obtainable in ‘‘a few easy lessons’’ by correspondence! 

All of these magazines carry advertisements with a common 
emphasis. Passing lightly over the many advertisements of 
mail-order ‘‘ psychologists,’’ ‘‘mind-training,’’ personality and 
success ‘‘secrets,’’ and baldness cures, one is arrested by ad- 
vertisements of what purport to be ‘‘psychology”’ schools, col- 
leges, and universities, from which, after a specified period of 
study (chiefly by correspondence), one may qualify for de- 
grees of: Ps.D. (Doctor of Psychology); Ms.D. (Doctor of 
Metaphysies) ; D.D. (Doctor of Divinity) ; and Doctor of Bio- 
Psychology. Those who prefer titles to degrees may become a 
‘*Bio-Psycho-Analyst’’ or an ‘‘Ortho-Psycho-Geneticist’’ by 
the same means. 
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The following quotations from some of the articles illustrate 
the types of statements which are current in the ‘‘ popular 
psychology’’ magazine: 


‘A mental defective in the finest kind of environ- 
ment will make no progress but a highly intelligent per- 
son in a poor environment will soon work himself up 
and out. However, it is a rather well established fact 
that inheritance makes us seventy-five per cent of what 
we are and environment contributes about twenty-five 
per cent.’’ (Psychology, Feb., 1937, p. 20.) 


‘‘There are two activities which cooperate in every 
thought: Interpretation of meaning and nerve action. 
We must assign meaning to nerve action or there is no 
thought. The intensity of the reaction is determined 
by the value placed on the idea by the individual. If 
the idea is sufficiently convincing to produce a major 
emotion, and the imagination is abnormally strong, the 
will is likely to be greatly weakened, or defeated. Per- 
sistent yielding to this type of reaction invariably re- 
sults in the destruction of the will-equilibrium, i.e., when 
the imagination, backed by a major emotion, comes into 
conflict with the will, defeat of the will is inevitable. 
This will explain the amazing increase of crime, and 
the distressing loss of ethical values.’’ (The Modern 
Psychologist, Mar., 1937, p. 43.) 


‘*With further advance in the science of electricity 
and magnetism does it not seem possible that instru- 
mental communication between this world and the next 
may become as commonplace as wireless communica- 
tion?’’ (Psychology, Mar., 1937, p. 23.) 


‘‘If you happen to be a shallow breather, it may 
surprise you to know that correct breathing exercises 
will improve your vision because your eyes will receive 
blood that has been purified by proper oxidation. . . .’’ 
(Psychology, Mar., 1937, p. 28.) 


‘‘Before one should waste his energy in this and 
that desire; before he goes to the center for answer to 
his desires it is best to lay those desires into the Great 
Mind and ascertain just what is a mere wish and what 
is the fitting and proper desire for that one individual.”’ 
(The Modern Psychologist, April, 1937, p. 47.) 
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In a discussion of marihuana the reader is left with the 
distinct impression that the use of this drug is non-habit 
forming and relatively innocuous. Yet recent medical re- 
search has shown that not only does the drug contain habit- 
forming elements, but that it tends to radically disorganize 
the behavior of its users. 

It is small wonder that the layman believes that psychology 
is interested primarily in the investigation of the abnormal, 
the supra-normal, instantaneous character analysis, sexual per- 
versions, and mind-reading and fortune-telling. It is perhaps 
gratuitous to point out that such impressions definitely lower 
the status of the legitimate professional psychologist. By the 
same token, moreover, the names of legitimate psychologists 
with university connections, attached to an occasional article, 
lend prestige and authority to the remainder of the articles 
in a given issue. 

It is considered essential for the student to complete certain 
basic courses in psychology before attempting advanced work. 
This is done, of course, to insure the student a better under- 
standing and more scientific interpretation of the material 
which he will encounter in the more complex branches of the 
science. This important detail, however, is overlooked by the 
proponents of ‘‘popular’’ psychology. No consideration is 
given to the fact that much of the information in their articles 
(especially that concerning the characteristics of mental dis- 
ease and sexual perversion) is apt to be misinterpreted often 
with disastrous results by the naive reader. All too common 
is the tendency for the casual uninitiated layman, after read- 
ing about the various symptoms of certain mental diseases, to 
find these symptoms in himself, inducing what may become a 
dangerous self-concern. The lay reader is not usually aware 
of the fact that many of these peculiarities are characteristic 
of all individuals, and that they do not signify mental 
abnormality unless they are present in an exaggerated form. 

There is frequent over-exaggeration of the benefits that the 
layman will receive if he will only practice ‘‘ practical psy- 
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chological principles.’’ Frequently psychology is represented 
to be ‘‘like a geni of the fairy tales (which) will work for you 
if you know how to control it.’ It is one thing to simply 
propound success formulae and personality secrets to be ap- 
plied by the reader; but it is quite another to realize the ex- 
istence of different levels of ability and potential development 
and their influence on the goals and aspirations of the individ- 
ual. Despite the wealth of factual information concerning the 
nature and operation of individual differences, the ‘‘ popular’’ 
psychologists proceed upon the assumption that all their prin- 
ciples and formulae will produce uniformly successful results 
for all and sundry alike. 

It should not be presumed that this interest in human nature 
is limited to these specialized magazines. An analysis of a 
year’s issue of each of fourteen well-known and widely read 
weekly and monthly magazines* revealed 83 articles which 
could be classified as definitely psychological in nature, and 
106 articles which were on the borderline between legitimate 
psychology and extensions of psychological hypotheses which 
the average scientific psychologist would rarely make. Some 
of these magazines carried no psychological articles in the 
issues examined, whereas in others articles on numerology, 
astrology, and physiognomy appeared, frequently without 
apology or qualification. 

Although the writers do not approve of current ‘‘popular”’ 
psychology as it is available to the lay public, it should not 
be assumed that they are therefore opposed to the extension of 
psychological knowledge to the general public. The point at is- 
sue is the way in which, and the persons by whom, psychology 
is to be popularized. 

Aside from some recent textbook attempts, scientific psy- 
chologists have, for the most part, ignored the growing demand 

2 Current Psychology and Psychoanalysis, April, 1937, p. 29. 

8 American Magazine, American Mercury, Atlantic Monthly, Collier’s, 
Fortune, Forum, Good Housekeeping, Harper’s, Ladies’ Heme Journal, 


New Republic, Saturday Evening Post, Scribner’s, Nation, and New 
Yorker. 
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for understandable applications of knowledge derived from 
the laboratory. Continued neglect by legitimate psychologists 
of this field of public service leaves it open to exploitation by 
the sensationalist and charlatan. 

Publication by the American Psychological Association and 
its recognized affiliates, of a popular magazine similar to the 
‘‘Hygiea’’ of the American Medical Association would be an 
important step in remedying this situation. Through such 
an organ it would be possible to bring to the layman in under- 
standable everyday language the findings of the scientific 
psychologists which may be legitimately applied in the in- 
terests of more effective living and better adjusted personal- 
ities. An editorial committee of the Association would provide 
a source of authoritative evaluation to which lay magazines 
might submit psychological articles before publishing them. 

To protect the public and the integrity of their science, psy- 
chologists must take the initiative in bringing to the lay reader 
the results of scientific investigation. Only by so doing can 
the influence of wilful or unconscious misrepresentation be 
counteracted. Such an educational program may be expected 
to culminate in legislation to eliminate the ‘‘quack’’ psychol- 
ogist with exaggerated guarantees of accomplishment for his 
esoteric formulae. 














ESSENTIAL CONDITIONS IN THE DETERMI- 
NATION OF THE EXTENT OF TRAIT 
VARIABILITY 


E. E. GHISELLI 
University of Maryland 


ULL’S* concept of trait variability is often quoted in 
connection with aptitude testing and vocational orien- 
tation to emphasize that an individual is not uniform 

in the talents he displays for different occupations. How- 
ever, the fact is usually overlooked that in his original report 
Hull was simply presenting the idea of trait variability and 
illustrating the methodology underlying estimates of its ex- 
tent. Because of the widespread uncritical acceptance of 
Hull’s report it seems worth while to consider the necessary 
conditions which must be fulfilled in order to have any ade- 
quate estimate of the extent of trait variability. 

Estimates of the extent of trait variability are obtained in 
the following fashion. A group of individuals is given a num- 
ber of aptitude tests. Their scores are transmuted into equiva- 
lent values such that all tests have the same variability in 
terms of the transmuted scores. A measure of these variabili- 
ties when compared with the variability of the tests, 1.e., the 
individual differences, gives an estimate of the extent of trait 
variability. In this manner Hull estimated that the range of 
abilities displayed by an individual on the average is 80 per 
cent as great as the range of talent of all individuals on any 
one test. A formula to be given below will show that the 
extent of trait variability may be determined from the inter- 
correlations between the tests. 

Let there be a to n tests, and 1 to N cases. In order to have 
all scores comparable let them be transmuted into standard or 
Z scores. The variances, o”, of all the tests, then, will be 

1 Hull, C.L. Variability in amount of different traits possessed by the 
individual. J. Educ. Psychol., 1927, 18, 97-104. 
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equal to each other and have the value of unity. Let 8? be the 
variance of the scores of any one case. The problem is to find 


M;s:, the mean of the variances of the individual cases. 
se ee + $x 


= x [=- (=| ee ae (Y] 


Expanding and rearranging terms, 


Ms =1-*-"—*m, (1) 








where M, is the mean of Py Cie A between the 
tests. Since all of the scores are standard scores, Mg: is ex- 
pressed in terms of the variance of the tests and is the per cent 
trait variability is of individual differences. 

From formula (1) it will be seen that the average of the 
individual variances is a function of n, the number of tests 
that is used, and of the magnitude of the intercorrelations 
between the tests. With a constant average intercorrelation, 
estimates of the extent of trait variability will be larger the 
greater the number of tests. Since Hull used 35 tests, the 
error in his estimate due to this variable will be relatively 
small. If a large number of tests is employed, as there ought 
to be in order to obtain an accurate measure of yee 
variance, in formula (1) : will tend to be zero, and ——z will 
tend to equal unity. Hence 

Mg:=1-M, (2) 

It will be seen from this latter formula that when an ade- 
quate number of tests is used, the extent of trait variability is 
wholly a function of the magnitude of the correlations between 
the tests. It follows, then, that factors which affect the mag- 
nitude of these correlations will also influence estimates of the 
extent of trait variability. Hull points out that unreliability 
of measurement is an important consideration. Since as the 
reliability of measures falls their correlations with other mea- 
sures may be expected to be lower, with unreliable measures 
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estimates of the extent of trait variability will be too large. 
Hull states that he attempted to correct for this error in his 
estimate but does not indicate how this was done. 

Anastasi* mentions that the homogeneity of the group being 
studied will be a factor influencing estimates of the extent of 
trait variability. Ordinarily the size of the correlations be- 
tween tests increases the more heterogeneous the group tested 
becomes. Since Hull used a group selected both as to age and 
ability, i.e., first year high school students, his estimate that 
trait variability is 80 per cent as great as individual differ- 
ences is probably too high for a description of the general 
population. 

In his study Hull attempted to make equivalent the scores 
on all of the tests he used by transmuting them to o-scores. 
Similarly, in the formula developed above all scores are given 
as standard scores. The use of o-scales to render scores on 
different tests comparable is justified only when the distribu- 
tions of scores on all tests are of the same shape. Normality 
of distribution is probably not a requisite, but if o-scales are 
used it is necessary that a given score on one test have the 
same meaning on all other tests in terms of a homologous loca- 
tion in a similar shaped distribution. There is no statement 
of whether or not this condition was fulfilled in Hull’s study. 

If estimates of the extent of trait variability are to have any 
value the aptitude tests that are used must be highly valid. 
If tests of low validity are used there can be no certainty of 
how closely the spread of an individual’s scores approximates 
, the true distribution of his aptitudes. In addition the tests 
- should cover all kinds of aptitudes, and not be restricted in 
any sense. Hull states that neither of these conditions was 
satisfied exactly in his study but feels that they were approxi- 
mated. However, he does not present the validity coefficients 
of his tests and in the writer’s opinion the range of abilities 
sampled by Hull is greatly restricted. 


2 Anastasi, A. Differential Psychology. New York: The Macmillan 
Co., 1937. 





TRAIT VARIABILITY 439 


In summary, conditions which must be met for any exact 
determination of the extent of trait variability are as follows. 
A large number of tests should be employed. These tests 
should have high reliability and validity, and in addition 
should represent a wide range sample of abilities. The range 
of talent should be the same as that of the population under 
consideration. Finally, if o-scales are used in order to render 
the scores on the various tests comparable, all tests should dis- 
play similarly shaped distributions of scores. 

In Hull’s report it is impossible to determine whether or not 
some of these conditions were met, and certainly some others 
were not. Clearly, then, Hull’s estimate that the range of 
abilities displayed by an individual is on the average 80 per 
cent as great as the range of talent of all individuals in any 
trait must be accepted as being only a very tentative estimate. 





A GRAPHIC METHOD FOR EVALUATING 
DIFFERENCES BETWEEN 
FREQUENCIES 


Application of a Method for Determining the Signifi- 
cance of the Difference in the Observed Frequencies 
of an Event in Two Contrasted Groups 


M. MARJORIE BOLLES 
AND 


JOSEPH ZUBIN 
New York Psychiatric Institute and Hospital 


NE of the most frequently used statistical techniques is 
that of determining the difference between the observed 
frequencies of an event in two or more contrasted 

series or groups of individuals. In most of these comparisons 
the important question is whether the two observed frequencies 
could have arisen in random samples of the same theoretical 
population. The usual procedure is to compare the fre- 
auencies directly by the use of the Chi Square method or to 
compute the proportionate frequency of the event in the two 
groups and compare the differences in the proportions with 
their standard errors. That these two methods lead to iden- 
tical results has been shown by several writers (3, 6, 7, and 10). 

The field of application of this measure of significance is 

quite extensive, ranging from item analysis in the construc- 

/tion of a test to comparison of rates and indexes in vital and 
economic statistics. The frequent use of such comparisons has 
led several writers to propose tables and graphic techniques 
that save time and labor (1, 8, 9,and 10). The present paper 
describes the application of the graphic method recently 
described by the last named author (10). 

The technique was applied to a series of anatomical, physi- 
ological, and psychological measures on 295 individuals about 
half of whom were psychiatric patients and the other half were 

440 











EVALUATING DIFFERENCES BETWEEN FREQUENCIES 441 


normal control groups. The psychiatric patients were divided 
into four sub-groups and a control group was provided for 
each of these. A total of 1230 comparisons was made. These 
comparisons were based on the occurrence or non-occurrence of 
particular events, physical characteristics, and responses. A 
sample four-fold table from which x? was calculated is given 
in Table 1. 














TABLE 1 
Occurrence of Event Y in Normal and Abnormal Groups 
Y Present Y Absent Total 
NOD sissies a b (a+b) 
Abnormals 2.2... € d (e+4) 
Total (a+e) (b+d) N 














It is estimated that the total amount of time that would 
have been required for computing the significance of the dif- 
ference by the ordinary Chi square method would be 100 hours, 
and by the t method (9), 35 hours. The time required by the 
graphic method was 20 hours. In applying this graphic 
method as described in its original presentation (10) we found 
certain short-cuts and improvements, the advantages of which 
will now be described. 

As was pointed out in the earlier publication (10), the pur- 
pose of the comparison of the frequencies of an event in two 
groups is usually to determine not the exact value of Chi 
square which arises from the observed discrepancy but 
whether or not the value indicates a statistically significant dis- 
erepancy. Thus, when confronted with the question whether 
the difference between frequencies ¢ and a is statistically sig- 
nificant, we need concern ourselves only with the question of 
whether this difference (c—a) is greater than the minimal 
amount that e:nstitutes a significant deviation from frequency 
a. For each possible frequency in one group there are two 
eritical frequencies in the other group, a lower and a higher 
value. For example, when two groups each consisting of 50 
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cases are contrasted, the two critical values that correspond 
to a frequency of 20 in one group are 33 and 8. That is, if an 
event occurs 20 times in one group, it must occur 33 or more 
times, or, 8 or less times in the second group before the differ- 
ence in the incidence of the event in the two groups becomes 
statistically significant. These data are shown in Graph I and 
Table 2. The locus of these critical values is the probability 
ellipse corresponding to a constant value of Chi square (10). 
After the ellipse is drawn the area bounded by the circumfer- 
ence of the ellipse contains all the points whose coordinates give 
values of Chi square that are less than the critical values. The 
area outside the ellipse contains all the points whose coordinates 
give rise to values of Chi square which exceed the critical 
value. The points on the circumference are the critical 
points sought (10). A sample ellipse based on these charac- 
teristics is shown in Graph I. 


METHOD OF PLOTTING THE ELLIPSE’ 


The ellipses were plotted on cross-section paper of 0.1 inch 
ruling, each division representing a frequency of 1. The num- 
ber of cases in the normal control group, (a+b), was laid out 
along the abscissa and the number of cases in the contrasted 
group, (c+d), along the ordinate. The center of the ellipse 
was the point P, ex ="). A line was drawn from the 
origin to this point and extended. This line was the line of the 
major axis. A perpendicular erected to this line at the point 
P was the line of the minor axis. The formula for the length 





p salad 2rN*¢”? 
of the major axis is K’= + or and for the length of the 
: } ee rN” »_(e+d) ee 
minor axis, K = + [ENS where = tat) , N = the total 


number of cases in both groups, ¢? =X, ¢”? = the critical value 
1 The authors are indebted to Mr. E. R. Johnson for technical assistance. 


2In reference (10) the value of r is given incorrectly as (o+8), 
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of ¢? corresponding to a Chi square of 6.635, n=1+r? + 2rq”, 
and m= + \/(1-r*)? + 4r?(1- ¢”)?. 





The derivations of these formulae have been given in a previ- 
ous publication (10). According to the method of determin- 
ing the ellipse given in the earlier publication, the formulae 
for the major axis and the foci are also given and utilized in 
the construction of the ellipse. These are, however, not neces- 
sary in our application of the method,* when the two contrasted 
populations are equal. 

Taking the characteristics of the major axis described in the 
footnote into consideration, the drawing of the ellipse is simpli- 
fied. In order to plot the ellipse, it is necessary to locate the 
point ‘‘V’’ (shown in Graph I) whose coordinates are (a+b, 
e+d), and draw a line from this point to the origin ‘‘O.’’ 
This line is then bisected (point P, which is ae! one and 
the minor axis, which has been determined by formula, is laid 
off along this bisector. The two axes define one specific ellipse 
which may be constructed by any one of several methods. 

The method we employed is the trammel method‘ described 

3 We know that the line of the major axis passes through the origin. 
We can now show that one end of the major axis (one of the vertexes of 
the ellipse) falls on the origin. The general formula for the ellipse when 
a and ¢ represent the variables is 

a?(¢? + r)r + 2ac(¢*—1)r+e*(rg*+1) - (a+e)rN¢"=0 
When a = 0, the first two terms of this equation drop out and the equation 


becomes 
e?(r¢? +1) -erN¢*=0 


Factoring the equation becomes 
e[e(r¢* +1) —rN¢*] =0 

We know that N, r, and ¢* are constants and are not equal to 0. There- 
fore, it is apparent that when a is equal to 0, c must be equal to 0 
rN¢’ 
r¢*+1° 
other value of c corresponding to the 0 value of a is positive, for the terms 
on the right side of the equation are all positive. 

4 In constructing the ellipse by the trammel method, a straight edge is 
used, the end of which is designated as point P’. From P’ the distance 


or to 





The 0, 0 point must therefore lie on the ellipse. The 
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by French (5). The advantage of this method is that it does 
not require the computation of the foci or the major axis, and 
does provide a highly accurate method of constructing an 
ellipse. 
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GraPH 1.—Critical Values of the Absolute Frequencies Yielding Sig- 
nificance Differences. 


The plotting of the ellipse must be very carefully done be- 
cause slight deviations in the placement of the line produce 
fairly large differences in the Chi square value of the points 


PV (which is the semi-major axis), and the distance PD (which is the 
semi-minor axis), are laid off. The straight edge is then moved keeping 
**V’? on the minor axis (actual or extended) and ‘‘D’’ on the major axis. 
The point P’ now traces an ellipse. The ellipsograph is built on the prin- 
ciple of this method. 
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on the curve. The deviations are greatest near the vertexes 
of the ellipse, slight errors resulting in relatively larger differ- 
ences of the Chi square values. The deviations in this region 
of the curve are not important however, because, as many 
writers have pointed out, Chi square is not as serviceable a 
measure of significance when the number of cases in any one 
cell is very small (2, 4). 

After each ellipse had been drawn, at least eight points on 
the curve were checked by computing Chi squares by the usual 
formula. The Chi squares so determined never varied more 
than from 6.3 to 6.9, the largest of these deviations occurring 
near the vertexes. After the ellipse had been checked in this 
way, a table of the critical values was constructed for the 
comparison of frequencies in the two groups. Taking a as the 
independent variable, there are two critical values of the de- 
pendent variable c, a maximal and a minimal corresponding 
to a particular value of a, as shown by the sample in Table 2. 


TABLE 2 


Sample of Critical Values for the Comparison of Frequencies in 
Two Groups of Fifty Individuals 








. Higher Lower 
Frequency, ¢’ Frequency, ¢” 
i eisednnccecntinnbian 33.0 8.0 
Res 34.0 8.7 
RSE ie ea 35.0 9.5 
i ciesitntineieincatinen 35.9 10.2 
i cictiiendisabtateowistis 36.8 11.0 
SC ae aes Wieser 37.7 12.0 
eiinindipinainidhints 38.5 12.9 
Oe re 39.3 13.8 
BP siiiitdirthaennniae 40.1 14.8 
iP cidienapinettitinace 41.0 15.8 
SP leat ahicaestaiecniterene 41.8 16.8 











The decimal places in these figures are approximations. Al- 
though the actual frequencies with which we are dealing are 
whole numbers, there is an advantage in giving the first decimal 
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place because we can then obtain a better comparison of the 
actual frequencies with the critical values where the frequencies 
approach significance. 

The seale used in plotting the ellipses was that of 0.1 inch rep- 
resenting a frequency of 1. In order to determine whether 
greater accuracy could be attained by enlarging the scale, it 
was doubled to 0.2 inch per unit of frequency, and the read- 
ings on the larger ellipse were compared with those on the 
smaller ellipse. Although the larger scale permits more accu- 
rate plotting there was not enough deviation between the read- 
ings from the two scales to affect the interpretations. The 
deviations between the two scales affected the first decimal place 
only. Within the limits of accuracy required for this problem 
the scale of 0.1 inch representing a frequency of 1 seems to be 
adequate, and also has the advantage of being easier to plot. 


STANDARD OF SIGNIFICANCE 


The standard of significance used was 1 chance in 100 
(P= .01) that the given four-fold table with fixed marginal 
frequencies could give rise to a value of Chi square that would 
exceed the value found. In other words, the difference be- 
tween the frequencies of the event in the two groups could 
have occurred through chance factors alone only one time in 
100. Corresponding to a P of .01, the value of Chi square is 
6.635 for a four-fold table with one degree of freedom (4). 
This critical value of probability was used rather than a P of 
.05 as suggested by Fisher (4) because our data are subject to 

_ greater errors of measurement than are strictly biological data. 
‘In constructing the graphs, ellipses based on a Chi square 
value of 5.412 (corresponding to a P of .02) were also plotted. 
These ellipses were concentric and coaxial with the ellipses 
based on a Chi square of 6.635 (Graph I). The data were 
first evaluated in terms of being ‘‘highly significant’’ (P= 
.01). If they approached significance with this standard, they 
were then evaluated in terms of the less strict criterion. 
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RESULTS 


The graphic method of determining the significance of the 
difference was used in 1230 comparisons between frequencies 
of events in contrasted groups. The time which would have 
been required for computations by the usuai Chi square for- 
(ad — be)? (a+b+e+d) 

mula, (= taab) (o+a) (ate) 5) for a four-fold 
table, and for the transformation method (9) was estimated 
from selected samples. A record was made of the total amount 
of time required by the graphic method. The computation of 
the minor axis, the plotting of the ellipse, the checking of the 
ellipse, and the construction of the table for the values of a 
and ¢ required about three hours and fifteen minutes for each 
ellipse. The amount of time saved by the graphic method as 
compared to the method of computing each Chi square indi- 
vidually is relatively greater when a large number of com- 
parisons are made from each ellipse. In terms of our approxi- 
mations of the time necessary for the two methods, the graphic 
method would result in a saving of time if thirty calculations 
of Chi square were required. 

Another advantage of the graphic method is that after the 
tables are completed no further checking is necessary, while 
the values of Chi square must be computed twice to check their 
accuracy. In drawing up the table from the ellipse any gross 
errors may be found by inspection because there are fairly 
regular increments or decrements between successive readings. 
If a gross error occurs, there will be a sudden, erratic varia- 
tion in the successive readings. Furthermore, by means of 
the graphic method a probability plot can be made of all the 
events or items which the ordinary methods do not afford. 

In our investigation, when the number of cases in one cell 
of the four-fold table was less than 5, the Yates’ correction for 
continuity was applied (4). This adjustment consists in mak- 
ing the observed frequencies less extreme than they really are 
by half a unit and then looking up these adjusted values in the 
graph. For example, in comparing a frequency of 15 in one 
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group to a frequency of 3 in the other group, the values of 144 
and 34 were actually used to determine whether the difference 
was significant. 


SUMMARY 


The graphic method of determining the significance of the 
difference of frequencies of contrasted groups was applied to 
anatomical, physiological, and psychological data from 295 
individuals. This method was applied because a large num- 
ber of comparisons between the incidence of particular events 
in two contrasted groups was necessary. By this method the 
absolute frequencies could be compared directly without the 
computation of standard errors, critical ratios, or percentages. 

1. A revision of the graphic method as described previously 
was introduced which shortens the time necessary to plot the 
ellipse. This revision consisted in determining the major axis 
graphically instead of arithmetically and in constructing the 
ellipse by the trammel method which eliminated the calcula- 
tion of the foci. 

2. The graphic method applied to our particular problem 
required approximately one-fifth the time necessary to make 
the comparisons by the usual method of determining each Chi 
square by formula. 

3. Although the larger the scale used in plotting, the greater 
will be the accuracy, the scale used in this investigation (0.1 
inch representing a frequency of 1) offers sufficient accuracy 
for the needs of the problem. 

4. On the basis of approximation of the time required by 
‘the graphic method and the usual methods, the graphic method 
is of practical value in saving time when the number of com- 
parisons desired is 30 or more. 

5. In general, it has been found that the graphic method of 
evaluating group differences is easy to use, is accurate within 
the needs of the problem, and results in a great saving of time 
when a large number of comparisons between group frequen- 
cies are to be made. 














10. 
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EXPERIMENTS IN THE OPERATION OF A 
PUNCH PRESS 


JOSEPH TIFFIN anp R. J. GREENLY 
Purdue University 


HERE is probably no single fabricating unit as widely 
used in modern industry as the punch press. Though 
every large industry makes use of this unit, very little 

experimental work in the psychological aspects of its operation 
has been conducted. 

It is the purpose of this paper, first, to describe an experi- 
mental testing punch press, constructed to investigate prob- 
lems which arise in the operation of this unit and, second, to 
summarize certain preliminary data which have been obtained. 

The job of operating a punch press is essentially one of 
coordination of eye, hand, and foot. One who lacks the basic 
ability necessary for this coordination is likely to be a slow, 
inefficient or unsafe operator no matter how much effort or 
industry he applies to the task. Though the necessary co- 
ordination of eye, hand, and foot might conceivably be mea- 
sured adequately with standard tests of motor coordination, 
it has seemed more desirable to construct the present test in 
the form of a miniature. By so doing, the test not only con- 
forms more rigidly to the actual job being performed, but also 
(and this is important) is more convincing to industrial men 
_ than a test, or battery of tests, which, at first glance, does not 
' geem related to the job. 

The testing press constructed for this investigation’ is shown 
in Figure 1. It is approximately four feet high, fitted with 
removable side-wings to hold the stock, and weighs approxi- 
mately 75 pounds. The driving wheel rotates 80 times per 
minute. The head of the punch press is activated by a foot 
pedal located under the right foot just inside the framework 

1 The press was constructed by Mr. Max Wastl, instrument maker for 
the Division of Education and Applied Psychology. 
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of the press. The stock consists of 50 pieces of galvanized 
sheet iron 44” x 53” and .033” thick with a hole slightly larger 
than the punch in the center of each piece. Persons to be 














Fic. 1. Operator Being Given the Miniature Punch Press Test. 


tested are first allowed to run 10 sheets through from left to 
right and another 10 sheets from right to left for practice be- 
fore the actual test is given. The test itself consists in running 
through the 50 sheets four times, first from left to right, then 
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from right to left, then from left to right, and, finally, from 
right to left. The time required for each 50 sheets is taken 
with a stop-watch. The time score is obtained by taking the 
total time in minutes for the four series of 50 sheets each. 

An unique feature of the press is that the punch itself is 
surrounded by a coil spring which permits the punch to stop 
while the head descends if the stock is not placed correctly in 
the jig or if, as occasionally happens, an inexperienced or care- 
less operator allows his fingers or hands to be under the 
punch as it descends. This safety feature is an absolute 
necessity in an apparatus of this kind. The punch is not fitted 
with a safety guard, though one could readily be installed, 
because a number of press foremen expressed the belief that 
the test would give a better measure of ability and habits of 
safety if the operator is given an opportunity to mispunch 
and make other mistakes which, in a real working situation, 
might cause breakage of the die or bodily injury or both. 

Located on the head and attached to the punch is a counter, 
so connected mechanically that if for any reason the punch 
meets a resistance as it descends, the counter records an error. 
The errors recorded include both mispunches of the stock and 
what, in a real press, would be bodily injuries. The error 
count includes all cases where the punch does not smoothly 
and easily go through the previously bored hole in the plate. 
The test results in two separate scores, a time score and an 
error score. These may be evaluated separately, or in 
combination, as described below. 


SUBJECTS 


The present investigation is limited to results obtained from 
three groups of subjects, namely : 

Group 1.......... 25 experienced punch press operators. 

Group 2......... 38 insulation stripping machine operators. 

Group 3.......... 38 college students. 

The test, as described above, was given to each member of 
the above groups, totaling 101 subjects. 
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RELIABILITY 


The reliability of the test, both the time score and the error 
score, was computed for each of the above groups and for the 
101 subjects as a whole. 

The reliability of the time score was computed by correlating 
the time for the first 100 plates with the time for the second 
100. The reliability of the error score was computed by cor- 
relating the number of errors for the first 100 plates against 
the number for the second 100. The reliability coefficients of 
the total test, obtained by stepping up the obtained correla- 
tions by means of the Spearman-Brown Prophecy Formula, 
are given in Table 1. 

TABLE 1 


Reliability Coefficients of the Time and Error Scores of the 
Testing Punch Press 











Coefficient 
of 

reliability 
Group 1 5 ae as 97 
BN I sincinictninccinnrpicrcennaine 74 
Group 2 Time score 85 
Error score ...... 74 
Group 3 Time score 85 
BN NI Scetcicesimensneeicesnsnns 94 
Combined 0 2 98 
groups 0 | ere 96 





In comparing the reliability obtained from the sub-groups 
with the reliability obtained from all subjects grouped to- 
gether, it will be noted that the latter reliability coefficients 
are higher. The reason for this is that the range of talent is 
increased by grouping experienced punch-press operators, 
operators of another kind of machine, and students who had 
never seen a punch press before the present experiment. In- 
asmuch as the test, when used in industry, will be called upon 
to select employees who can operate a punch press from large 
groups of applicants which are likely to include a number of 
inexperienced operators, it would seem that the reliability co- 
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efficients obtained from the combination of groups is the most 
logical one to use in evaluating the test. 

A second point which will be noted in Table 1 is that the 
reliability figures for speed are higher than those for accuracy. 
This means that when the test is used in selecting operators 
for a job where accuracy is of paramount importance, it would 
be wise to measure the applicants upon the basis of 400 or 
even 600 plates rather than the 200 used in this study. 

On the whole, however, the reliability coefficients summa- 
rized in Table 1 compare quite favorably with corresponding 
values for other standarized tests of this general type. 


VALIDITY 


In the first attempt to determine the validity of the punch 
press test as a measure of actual efficiency in operating this 
kind of unit, an effort was made to correlate the scores on the 
test (both speed and accuracy) with efficiency ratings of punch 
press operators obtained from foremen. Supervising the 
group of 25 punch press operators comprising Group 1 were 
two foremen, both of whom felt able to rate the men upon 
speed, accuracy, and safety. In rating the operators, the 
rank order method was used. The name of each operator was 
typed upon a separate card. Each foreman was asked to rate 
the operators three times, once according to speed, once ac- 
cording to accuracy, and once according to safety. Had there 
been a reasonable amount of agreement between the ratings 
of the two foremen, this method would have yielded a satis- 
, factory criterion against which to validate the test. The re- 
liability of the ratings, however, was disappointingly low, the 
correlations between the two sets of ratings varying from .04 
to .40. Obviously, with the reliability of the criterion as low 
as this, correlations of appreciable size between the test and 
criterion could not be expected. However, the ratings of the 
two foremen were pooled and correlated with the test scores. 
The resulting coefficients of correlation are summarized in 
Table 2. 








a 


OPERATION OF A PUNCH PRESS 455 


TABLE 2 


Correlations between Scores on the Testing Punch Press and Pooled 
Ratings of Two Foremen. Subjects, 25 Punch 
Press Operators 








Pooled Pooled Pooled 

speed accuracy safety 

rating rating rating 

Speed On test oo ccconn + .63 — 55 —- 15 
Accuracy on test ................. +.15 + .03 + .60 





Though the correlations in Table 2 are low, they do indicate 
that the operators who were most rapid on the test tend to be 
rated highest in speed, lowest in accuracy, and lowest in 
safety. They also indicate a tendency for the operators who 
were most accurate on the test to be rated highest in speed, 
highest in accuracy, and highest in safety. However, only 
three correlations in Table 2 are far enough from zero to 
warrant consideration. They are the correlations of + .63 be- 
tween test speed and rated speed, —.55 between test speed and 
rated accuracy, and +.60 between test accuracy and rated 
safety. Though far from what might be desired, had the cri- 
teria themselves been more reliable, these correlations indicate 
that the test does tend to discriminate between efficient and 
inefficient operators as rated by their foremen. 

A second attempt to determine the validity of the test 
centered around a comparison of the speed-accuracy relation- 
ship observed in the three groups of subjects. It was early 
observed, in inspecting the data, that a negative relation exists 
between speed and accuracy on the test. The correlations are 
summarized in Table 3. 

TABLE 3 


Correlations between Speed and Accuracy on the Punch Press Test 
for the Three Sub-groups and the Combination Group 





r 








Punch press operators ~ 13 
Insulation stripping machine operators .................. — 32 
University students -.17 





All groups combined — 32 
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Though the correlations in Table 3 indicate a tendency for 
high speed to be accompanied by low accuracy, a more mean- 
ingful interpretation of these data is shown in the curves of 
Figure 2. These curves were obtained from the scattergrams 
of speed against accuracy for the three groups by fitting a 


curve of the form y=a Pea to the points representing the 


individual subjects in each scattergram. In this equation, ¢ 
is the value of x to which the curve is asymptotic on the y 
axis. The value c was set at 2.6 minutes because this was the 
most rapid time found among the 101 subjects tested. Since 
2.5 minutes is the time required by the punch to descend 200 
times when run automatically, a person punching 200 plates 
in 2.6 minutes is operating the machine at approximately 
maximum speed. In fitting the curves, the criterion of least 
squares was used. The three curves in Figure 2 may be 
taken as indicative (within the limits of the accuracy of the 
data) of the relation between speed and accuracy in operating 


the testing press for the three groups studied. The equations 
of these curves are: 


Group 1 Punch press operators Errors =-.0008 + ane 


Time — 2.60 

Group 2 Insulation stripping 2.00 
machine operators Errors=8.66 + Time — 2.60 

4.33 


In the above equations, the term errors refers to the number 
of mispunches and time to the time in minutes required to put 
200 plates through the press. 

A number of interesting points may be observed in Figure 
2. For all groups, slower speeds are accompanied by greater 
accuracy. The students, who were the most rapid of the three 
groups tested, also made the most errors. The curve repre- 
senting the students and the one representing the insulation 
stripping machine operators are represented mathematically 
by equations with similar constants, though the machine op- 
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3 4 5 6 7 8 9 10 
MINUTES TO PUNCH 200 PLATES 
Fig. 2. Speed-Accuracy Relation Found for Three Groups of Sub- 
jects Tested With the Miniature Punch Press. 


erators, due probably to habits of safety, set a slower pace for 
themselves than did the students and therefore fall upon a 
different portion of the curve. In one sense the students and 
the stripping machine operators may be considered as a homo- 
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geneous group since neither have had experience in operating 
a punch press. They differ mainly in the fact that the 
students considered speed of most importance, whereas the 
stripping machine operators considered accuracy of most im- 
portance. This difference in point of view resulted in locating 
these groups upon different parts of the curve. The curve 
for the punch press operators, however, is represented by an 
equation with quite different constants. The number of errors 
corresponding to any given speed is lower than for either the 
students or stripping machine operators. This is perhaps a 
better indication of the validity of the test than the correla- 
tions with foremen’s ratings already discussed. In other 
words, the test does distinguish between experienced punch- 
press operators and persons who are attempting to run a 
press for the first time. Another fact brought out by Figure 
2 is the nature of the relationship between speed and accuracy 
for experienced operators. This relation may be used to ad- 
vantage by a production manager who employs a crew of press 
operators. If, for example, he wishes to speed up the opera- 
tion by 10 per cent, he may infer from Figure 2 approximately 
how much decrease in accuracy is likely to result. 


SCORING THE TEST IN PRACTICE 


The simplest way to score the test in practice is by means of 
the chart shown in Figure 3. The curves shown in this chart, 
constructed from an analysis of the scattergram of the punch- 
press operators, reveal at a glance where a given operator 
stands with respect to the group as a whole. For example, 
if an operator completes the test in five minutes without 
making any errors, he is in the highest 10 per cent of those 
tested. If he requires six minutes and makes one error, he is 
in the third 10 per cent group. If he requires ten minutes to 
complete the test and makes one error, he is in the fifth 10 per 
cent group or just slightly above the bottom of those tested. 
If he makes six errors and requires six minutes or more to 
complete the test, he is in the lowest 10 per cent of those 
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Fig. 3. Chart for Combining Speed and Accuracy in Scoring the 
Miniature Punch Press. 





tested. This chart makes it possible quickly to locate any 
given combination of error and speed scores in the correct 
10 per cent group or decile. 

Though the chart shown in Figure 3 is adequate for most 
purposes of evaluation, it is sometimes desirable to consider 
the error score and the speed score independently of each 
other. For example, in certain types of industrial punch- 
presses which utilize a die that is expensive or cannot be 
adequately guarded, the element of accuracy is of paramount 
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importance. In other types of presses, which utilize a die that 
is less expensive or can be effectively guarded, speed assumes 
a more important role. If it is desired to evaluate speed and 
errors independently, the data shown in Table 4 may be 
utilized. 

TABLE 4 


Percentile Rank Equivalents of Time and Error Scores on Testing Punch 
Press. Data Based on 25 Experienced Punch Press Operators 








Time in minutes 
to punch 200 — pap ened — 
plates 200 plates 
4.40 or less 96-100 0 80 - 100 
4.41 — 4.80 91- 95 1 65-— 79 
4.81 -5.20 86-— 90 2 40-— 64 
5.21 — 5.60 61— 85 3 30- 39 
6.01 — 6.40 46-— 60 4 20- 29 
6.41 — 7.20 21— 45 5 15- 19 
7.21 — 7.60 1l- 20 6 10— 14 
7.61 or longer l1- 5 7 5- 9 
8 38- 4 
9 2 
10 or more ‘1 





SUMMARY 


A miniature punch press for measuring ability to operate 
an industrial punch press is described. The reliability and 
validity of the test were studied and found satisfactory. 
Norms for evaluating the scores of experienced and inex- 
perienced punch-press operators are given. With all oper- 
ators studied, a negative relation between speed and accuracy 
was observed. The nature of this relationship has been ex- 
amined and summarized by means of curves fitted to the data. 
These curves may be used to estimate the probable change in 
accuracy which will accompany a speeding up or slowing 
down of the operation. 

















THE USE OF PSYCHOLOGICAL TESTS IN THE 
SELECTION OF STUDENT-NURSES* 


K. C. GARRISON 
State College of the University of North Carolina 


VERY careful observer of human beings recognizes that 
3 there are wide differences in traits and capacities. One 
of the most extraordinary things about any such an 
examination is the astounding diversity in their fundamental 
make-up. Hereditary forces started them off with an enor- 
mous variety of structural characteristics; providing all the 
while for certain common structural and functional qualifica- 
tions out of which human nature emerges. It is on the basis 
of these differentiated abilities that specialization and indi- 
vidualization have developed, and it is a result of the wide 
variety of individual traits and capacities that refined tech- 
niques have been constructed for their evaluation. It is, 
furthermore, this diversity among human’ beings that has 
enabled civilization to grow in so many ways and surmount so 
wide a variety of obstacles. It is on this basis that efforts were 
made at Rex Hospital, Raleigh, N. C., beginning in the fall of 
1937-38 to select student-nurses that have the aptitude to do 
the work required and at the same time possess personality 
traits that will enable them to adjust satisfactorily to nursing 
activities. 


REVIEW OF PREVIOUS STUDIES 


An abbreviated review of some of the most recent studies 
dealing with this problem should prove valuable as a supple- 
ment to, as well as a basis for, more accurately evaluating the 
results from this study. 


* Paper presented at the State Association meeting of the North Caro- 
lina League of Nursing Education, in Asheville, October 13, 1938. 
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Bregman,’ in an extensive survey of the mental ability of 
student-nurses noted that the distribution of scores was quite 
similar to that of students in normal schools. She says, 
‘*Every level of ability found among college students is to be 
found among students of nursing, but there are relatively 
fewer nurses at the higher levels, and the average college stu- 
dent surpasses the average nurse-in-training in the qualities 
measured by an intelligence test.’’ Studies in the selection of 
student nurses in Pittsburgh? showed that intelligence test 
scores did not correlate at all closely with ratings used as cri- 
teria of success in the practical work of a training course. 
They correlate somewhat better with the grades in the theo- 
retical subjects. Jones and Iffert recommend their use as one 
of several aids in selecting from among candidates, together 
with high school achievement tests and a special test of apti- 
tude for nursing. A correlation coefficient of .72 + .07 was 
obtained between the Intelligence Quotient and examination 
grades of student nurses in Prague.* The IQ range of the 
nurses was from 70 to 136, with a mean of 99. With one 
exception, all of those having an IQ below 95 failed the exami- 
nations—the average IQ of those failing was 86.6, while that 
for those passing was 102. This would indicate that the exam- 
inations are rather selective in nature, selecting students to a 
rather marked degree on the basis of intelligence. On the 
basis of these findings, intelligence tests were incorporated into 
the admission procedure. 

A follow-up study was made of 58 members of a class enter- 
ing a three-year nursing course.‘ These student nurses had 

1 Bregman, Elsie O., ‘‘The Performance of Student Nurses on Tests of 
Intelligence,’’ Nursing Education Bulletin, New Series, II. March, 1933. 

2 Jones, W. B., and Iffert, R. E., Fitness for Nursing: A Study in Stu- 
dent Selection. Pittsburgh, Bureau of Educational Records and Research, 
1933. 

8 Sumrizova, A., ‘‘Uber die Ausuahl der Kandidatinnen fiir die Pfleg- 
errinnenschule auf Grund der Intelligenzpriifungen,’’ C. BR. Eighth Conf. 
int. Psychotech, Prague, 1935, pp. 374-378. 


4O’Connor, J., and others, ‘‘A Two Year Follow-Up of 58 Student 
Nurses,’’ Tech. Rep. Human Engng. Lab., 1936, No. 8. 
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been given a battery of tests at the time of the beginning of 
their training period. It was found that an English vocabu- 
lary test when combined with a word checking test furnished 
an excellent basis for the prediction of classroom success, while 
the results on the O’Connor Wiggly Block Test was related to 
success in ward work. 

In 1934 the Minnesota League of Nursing Education ap- 
pointed a committee on testing to supervise studies that were 
conducted designed to improve methods students for private 
schools of nursing in the state. The research program was 
conducted by the University of Minnesota and a final report 
presented in January, 1937.5 This is probably the most exten- 
sive study that has been conducted in this field. Students 
enrolled in some twenty schools in the fall of 1934, the fall of 
1935, and the winter of 1935 were tested with a battery of 
tests. The results from these tests were correlated with each 
student’s grades in the various fields of instruction. Various 
criteria of success were used based upon grades and final ex- 
aminations on subject matter studied. Most of the correla- 
tions obtained were rather low, but indicate the presence of 
some relation between the test scores and grades. It is stated 
that, ‘‘In general, the four tests, Moss Nursing Aptitude Test, 
College Aptitude Test, Cooperative English Test, and the Co- 
operative General Science Test, yielded the best results.’’ The 
unreliable procedure for grading, along with lack of standard- 
ization of a grading system, is given as the most plausible 
explanation for the lack of higher correlations. However, it 
is pointed out that such tests could be used to a very worth 
while advantage in the identification of potentially successful 
student-nurses. 

A list of ten composite traits which are amenable to training 
but for which a candidate should have superior aptitude, is 
presented in a study by Catherine Cox Miles. These traits 

5 Williamson, E. G., Stover, R. D. and Fiss, C. B., ‘‘The Selection of 
Student Nurses,’’ Jour. Appl. Psychol., 1938, Vol. 22, pp. 119-131. 


® Miles, Catherine Cox, ‘‘The Personality Development of Student 
Nurses,’’ American Journal of Nursing, 1934, vol. 34, No. 2. 
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were arrived at on the basis of a consensus of expert nursing 
opinion regarding the qualifications possessed by able nurses. 
These are: 


**1. Genuine liking for people and ability tactfully to work 
with and for them. 


High grade of intelligence and understanding, with 
oot general education and broad interests. 

motional maturity, stability, and self-control seasoned 
with patience and a sense of humor. 

Good physical health and cheerful personal outlook. 
Integrity of character, exemplary ideals and morals; 
refined tastes; tolerance. 

Sense of responsibility coupled with personal reliability 
and loyalty. 

Attention to details, good observation with scientific 
attitude, and openmindedness. 

Resourcefulness and adaptability. 

Cleanliness and attractiveness in appearance. 

Ability to teach.’’ 

Occupational ability patterns. That occupational ability 
patterns exist seems quite plausible. There are all combina- 
tions of personality patterns, and there are all combinations 
of job characteristics. The function of tests, rating scales, 
interviews and other devices is to find those individual occupa- 
tional profiles that will harmonize with the description of cer- 
tain occupations. Those people are happy and best adjusted 
who are in those occupations which are in harmony with their 
distinctive pattern of ability and interest. Trabue says: ‘‘The 
ability patterns for some occupations are very much alike, 
while those for other occupations are decidedly different. It 
seems probable that there are definite families of occupations, 
and that one occupation in the family calls for almost exactly 
the same patterns of ability as any other, although the specific 
knowledge or skill required in the two occupations may be 
quite different.’’* 

Aptitudes and personality traits indicative of capacity to 

7 Trabue, M. R., ‘‘Oceupational Ability Patterns,’’ Personnel Journal, 
1932-33, Vol. 11, pp. 350-351. 
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profit by courses of training given to student nurses, and of 
probable success as a nurse, resemble in certain respects the 
aptitudes characteristic of the physicians with whom these 
workers collaborate. The nurse probably needs personality 
traits in many respects similar to the well-known family phy- 
sician rather than those that may characterize the specialist. 
Both doctor and nurse need more than ordinary grit, stamina, 
and physical endurance. Prior to the middle of the nine- 
teenth century most of the nurses were men, especially since 
there were heavy loads to lift, and occasionally long hours of 
fatiguing labor of which it was supposed only men were capa- 
ble. Today a nurse without a strong physical constitution is 
in most cases under a handicap. A nurse is usually an assis- 
tant, carrying out meticulously the orders and directions of the 
doctor. And although she needs to understand a good deal 
about physiology, materia medica and sanitation, she is not 
expected to have the scientific background and much detailed 
medical knowledge, or to exercise the highest order of reason- 
ing as is essential for making a difficult diagnosis. This is not, 
however, saying that a keen mind is a handicap; quite the con- 
trary. But it does indicate that it is relatively less important 
than are the aptitudes for developing a well-balanced person- 
ality and for acquiring the traits, knowledge, and skills that 
are essential for the doing of the work. 


THE PRESENT STUDY 


The data for the present study were obtained during the 
year 1937-38. The student-nurses involved in this study were 
given the Bernreuter Personality Inventory, the Otis Self-Ad- 
ministering Tests of Mental Ability, the Iowa Reading Tests, 
and the Detroit Mechanical Aptitude Tests for Girls. The 
results from these tests have been studied in relation to grades 
on certain academic studies, grades secured on practical work, 
and the student-nurses Efficiency Record. 

A number of student-nurses dropped out of school. Various 
factors accounted for their leaving school, the most prevalent 
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of which were: (a) lack of ability to do the work, (b) person- 
ality and health factors, and (c) change of life plans, such as 
marriage. Omitting these entirely, a comparison was made 
between the test scores of those making the highest and those 
making the lowest grades in 93 hours of work in anatomy and 
physiology, 20 hours of work in psychology and 45 hours of 
work in chemistry. The three grades obtained from these sub- 
jects were combined and the average obtained. The standard 
psychological test scores for the ten girls making the highest 
average grades were then compared with those for the girls 
making the lowest. Complete data were available for 33 girls. 
The averages obtained are presented in Table 1. 


TABLE 1 


Comparison of the Average Test Scores of the Ten Student-Nurses Making 
the Highest Average Grades with the Ten Making the Lowest on 
Anatomy and Physiology, Chemistry, and Psychcology Classes 








Ten highest Ten lowest 
Intelligence quotient 112 96 
Mechanical aptitude 148 129 
Reading comprehension ............. 110 86 
Reading rate 24 24 














Certainly on the basis of these data theoretical grades are 
closely related to intelligence, mechanical aptitude, and read- 
ing comprehension. The method of determining grades in 
nursing arts is sufficiently complete and objective to provide 
a good criterion for their practical work. The test scores of 
the ten students with the highest grades were again compared 
with the ten with the lowest. These are presented in Table 2 
and indicate the same general trend and relationships found 
for grades in the more theoretical subjects. 

A more detailed statistical analysis of the data was made 
through the use of correlation coefficients. Through this de- 
vice the relationship between grades and psychological test 
scores are expressed in a more quantitative manner. Table 3 
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TABLE 2 


Comparison of the Average Test Scores of the Ten Student-Nurses Making 
the Highest With the Ten Making the Lowest Average Grades 
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Ten highest Ten lowest 
Intelligence quotient .................. 108 93 
Mechanical aptitude ..................... 146 128 
Reading comprehension .............. 110 78 
Reading rate 25 22 

















presents correlation coefficients between the psychological test 
scores and grades of a more academic type and those in nurs- 
ing arts. It is of especial interest to note that psychological 
test scores relate more closely to the nursing arts grades than 
to the academic grades (grades on anatomy and physiology, 
psychology, and chemistry). This is probably due to the fact 
that nursing arts grades are more objectively determined and 
are not influenced to such a great degree by a differential edu- 


TABLE 3 
Correlations Between Test Scores and Average Grades (N = 33) 














Academic ay 

grades arte 

Intelligence test scores ........... 48 59 
Mechanical aptitude test 

scores 35 37 
Reading comprehension test 

scores 36 55 

Reading rate test scores ........ .02 36 











cational background. Partial correlations have not been ob- 
tained, but one can rather safely assume that the relationship 
would be raised considerably by properly weighting these vari- 
ous items and getting a combined score. The use of the results 
of all three tests (except for reading rate) for prognosis of 
academic work, and the use of all the tests for the prognosis 
of efficiency in nursing arts should prove valuable in selecting 
student-nurses. 
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A careful analysis of individual profiles and a more detailed 
ease study of each girl from the two groups will show certain 
personality differences that are especially important in select- 
ing student-nurses. The fact is, within recent years the uni- 
tary nature of the individual has been emphasized. Personnel 
workers and counselors are considering not only a number of 
different traits conceived of as valuable in a careful personal- 
ity appraisal, but are, furthermore, studying these traits as 
they relate to each other. That is, there is a growing recog- 
nition of the necessity of considering the personality pattern 
rather than so many discrete traits. In order to evaluate the 
personality patterns of the student-nurses, individual profiles 
were constructed for each individual. An illustration of these 
profiles is presented in Figure 1. 


Emotional Instability 


Self-sufficiency 


Introversion 


Dominance 
Self conscious 

Non-sociable 'e 
Mechanical . 


Intelligence 
Reading Comprehension 
Reading Rate 








0 10 2hlUSOUlUlCUCKOOCUSOlCCNCiaECDs—s«éd200 
The Psychograph Percentile Scores 


Fie. 1. Typical Psychograph of a Student-Nurse. 


Looking at the chart without considering exactly what it is 
dealing with, but merely to analyze its structure, we can see 
that the horizontal margin is divided into ten sections, each of 
which represents a decile based upon percentage with an inter- 
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val of ten per cent for each decile. It may also be noted that 
at the point representing the mid-point, or the 50th percentile, 
a heavy line is drawn vertically. This heavy line represents 
the median, or in other words, the point below which lie 50 
per cent of the group and above which lie 50 per cent of the 
group. The basis for the chart is, of course, the percentile 
score. A percentile score is that score which indicates a sub- 
ject’s standing in a test, or trait manifestation, etc., as ex- 
pressed in terms of the percentage of people of the group 
whose scores he exceeds. For example, if a runner, in running 
a race, was able to do 100 yards in 10 seconds, and crossed the 
finish line with 50 per cent of the racers still behind him, then 
his percentile score would be 50, for he would be just at the 
mid-point of the group. 

A fairly detailed study was made of the five student-nurses 
whose Efficiency Records indicated that their professional fit- 
mess and personality.as revealed in their work activities was 
most satisfactory. These were compared with the five whose 
Efficiency Records gave indication of being least satisfactory. 
Qualitative differences were especially noticeable in the pres- 
ence of traits among the latter group that when organized into 
a pattern did not give a personality desirable for student 
nurse activities. Examples of traits presented together more 
often among this group are a dominant, self-confident attitude 
accompanying mediocre ability ; dominance accompanying in- 
troversion ; extroversion accompanying a sort of lack of socia- 
bility, ete. More unevenness of personality trait patterns were 
present here. 

A comparison of the average profile for these two groups is 
presented in Figure 2. This shows that the student nurses 
with the most satisfactory work records are slightly more 
introverted and emotionally unstable than those with a less 
satisfactory record; however, both groups scored below the 
median in these traits. The poorly adjusted group was con- 
siderably more dominant, slightly less self-conscious and more 
non-sociable. These profiles show a significant difference in 
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certain directions and should be of great value in the selection, 
direction and guidance of student-nurses. 

Complete data were available on thirty-three student-nurses 
who were given the Bernreuter Personality Inventory, at the 
time of their entrance into training in the fall and again on 
the following March 23. A study of the nature and direction 
of the changes in response to the various items is of in- 
terest. Approximately the same number of items of the 
Personality Inventory were changed to yes. A comparison 
was made between the average personality test scores of the 


Emotional Instability = highest 


Self-sufficiency + ——-«= lowest 
Introversion 
Dominance 

Self conscious 


Non-scciable 
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_ Percentile Scores 


Fig. 2, Average Percentile Ratings for the Five Girls Having the Best 
Efficiency Rating and Average for the Five Having the Lowest Efficiency 
Rating. 


six girls who made the most changes with the six who made the 
smallest number of changes. The six making the most changes 
scored more unstable than the six making the fewest changes, 
the average percentile scores being 64 and 34, respectively. 
Likewise, the girls of the group making the most changes were 
more introverted, more submissive and more self-conscious. 
There were no significant differences in the intelligence, me- 
chanics] aptitude and reading comprehension of the two 
groups. The group making the greater number of changes 
scored on the average considerably higher in rate of reading. 
These changos depict personality characteristics that are sig- 
nificant and of interest to one concerned with a detailed analy- 
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sis of these psychological profiles. However, their practical 
values may be somewhat limited. 

The second testing of the group of thirty-three student 
nurses gave a basis for determining the trend in the change of 
personality. An observation of the profiles on the second 
testing revealed fewer extremes, and a trend towards a better 
balanced personality. The quantitative treatment of the re- 
sults of Table 4 indicates a slight trend towards emotional 
stability and extroversion, with a rather decided development 
towards dominance. The higher average score on the second 
test for non-sociability, and the lower average score for self- 
consciousness indicate developments toward a greater self- 
confidence and social independence. 


TABLE 4 


Comparison of the Average Percentile Scores of the Thirty-Three Student 
Nurses on the Bernreuter Personality Inventory at the Time of 
Entrance of Training with Those Obtained Siz Months Later 














First testing Second testing 
Emotional instability ............. re 43 35 
Self-sufficiomey iceccceccsenee 40 42 
Introversion 33 30 
Dominance 26 54 
BelP-COmsei Os onccccccccvcsncesscvsveeseeeere 47 32 
Non-sociable 35 43 














GENERAL CONCLUSIONS 


In the selection of student-nurses there is always the prob- 
lem of what personality pattern is not desirable. This problem 
prevails in all fields of work and is one that should receive 
careful consideration in connection with the problems involved 
in the selection of student nurses. Some practical problems 
or questions that need to be studied in this connection are: 
To what extent are the training programs for student nurses 
at different places similar? To what extent are the standards 
of class work on the same level? To what extent do the dif- 
ferent points concerned with training nurses agree on what is 
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the desirable personality pattern for nurses? To the extent 
that these items are similar in nature can the results obtained 
at Rex Hospital be applied to other places? You are probably 
better able to answer these questions of similarity than I; but 
I take it that there is a fair amount of agreement as to the 
personality patterns that make up the desirable nurse. I am 
under the impression that there has been a sufficient standardi- 
zation of the work, and along with sessions of study and ex- 
change of ideas to make the programs fairly uniform and to 
develop probably to a lesser degree similar standards of 
quality of work for graduation. Therefore, I am of the opin- 
ion that the results obtained at Rex Hospital in Raleigh will 
be quite applicable to other points in North Carolina, and will 
be most applicable to situations and training conditions that 
are most similar to those prevailing at Rex Hospital. 

Intelligence test scores, mechanical aptitude scores, and 
reading test scores are indicative of both theoretical and prac- 
tical work. Case studies show that these are valuable in fore- 
casting ability in the direction for which the tests have been 
designed. These findings are, therefore, in harmony with the 
results of previous studies. The tests used in this study are 
standardized tests that have been developed with a rather high 
degree of reliability and validity. The personality test scores 
are of most value in studying occupational fitness when con- 
sidered in relation to each other and to the student-nurses’ 
various abilities. A study of these profiles reveals that ezx- 
treme traits may become most desirable when associated with 
other traits in a pattern that presents a desirable one. This 
is especially noticeable in a comparison of individual psycho- 
graphs of those with the best with those with the poorest 
Efficiency Record. A careful analysis of an individual’s 
psychograph will oftentimes show the nature of the personality 
pattern that is a hindrance to the adequate development of the 
student-nurse. The personality profile used at Rex Hospital 
should serve as a valuable means to aid in the selection, train- 
ing, and guidance of student-nurses. 





| 





THE AMBIGRAPH LATERALITY TEST’ 


JOSEPH JASTAK 
Delaware State Hospital 


HE problem of laterality, as a factor determining certain 
f* individual and social adjustments, has been gaining in 

scientific importance ever since Broca suggested in 1861 
the unilateral control of human speech. Although Broca’s 
theory of the localization of speech functions is by no means 
universally accepted, the dominance of one brain hemisphere 
over the other in the normal development of speech and other 
language functions is generally regarded as an established 
fact. 

The inzidence of lefthandedness in groups of socially mal- 
adjusted individuals is almost always found to be greater than 
in the population at large. We need but mention the findings 
of Lombroso in his study of delinquents and those of Ewald 
Stier? who, in a monumental book published in 1911, discussed 
with great thoroughness the implications of lefthandedness in 
manual occupations, in learning to speak, read, write, and 
spell, and in numerous social adjustments. Erlenmeyer, pro- 
pounding in 1879 his theory of the antitropism of body move- 
ments, stressed the difficulties encountered by lefthanders in 
learning to write. In the beginning of the present century 
Makuen, a neuropsychiatrist, and Claiborne, an ophthalmolo- 
gist, linked the incidence of stuttering and reading deficiencies 
to lefthandedness. More recently Orton, Ranschburg, Vernon, 
Dearborn, M. Monroe, and others have pointed out that con- 
flicts between right and left are quite common in children 
suffering from reading, spellisig, aud writing difficulties. 

Orton also found that lack of dominance in the motor sphere 

1 All materials for this test may be purchased from the Psycho-Mechani- 
eal Laboratory, 4116 47th Street, Long Island City, N. Y. 


2 Stier Ewald, Untersuchungen Uber Linkshindigkeit and die Funktion- 
ellen Differenzen der Hirnhalften, Gustav Fischer, Jena, 1911, 352 pp. 
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may cause such severe incoordinations as to be mistaken for 
an ataxic disorder. Whatever the causal relationship between 
lefthandedness and certain social maladjustments may be, to 
the clinical and educational psychologist the problem is one of 
primary interest. 


THE MEASUREMENT OF LATERALITY 


The accurate determination of lateral dominance is not a 
simple task. One reason for the difficulties encountered in 
measuring handedness or sidedness is the bi-lateral nature of 
human conduct. Most people are able to accomplish the same 
task with both sides of the body equally well. Another diffi- 
culty lies in the crudeness of testing techniques. Current 
methods do not differentiate between potential tendencies and 
acquired habits. Thus, if a child throws the ball with his 
right hand, he may still be latently lefthanded. Outwardly he 
may appear righthanded because of prolonged training of the 
inferior arm and simultaneous neglect of the superior arm. 
While some of the gross motor acts may seem rightsided, the 
more subtle unconscious tendencies, less subject to training, 
may still be entirely leftsided. 

Many tests of handedness and sidedness have been used in 
the past. Stier describes about forty different tests. They 
range from post-mortem measurements of the length and cir- 
cumference of the bones of the limbs, through tests of sensa- 
tions and strength of grip, to tests of complex behavior func- 
tions such as reaching, throwing, tapping, manipulating, and 
writing. The relative size, skill, speed, accuracy, and effi- 
ciency of the hands, arms, and legs are the chief criteria of 
comparison. Most of the results obtained from these tests are 
inconclusive partly because the causal relationship between 
structural differences and functional sidedness is not definitely 
known, partly because tests of complex behavior are greatly 
influenced by training and therefore fail to establish the role 
of original dominance which may be different frem what ordi- 
nary testing procedures indicate. The influence of training is 
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largely eliminated from the ambigraph tests. The basic idea 
of the test is to let the subject draw assymmetrical figures with 
both hands at the same time on an upright plate. It was first 
used in an experimental set-up by Van Riper.* The ambi- 
graph battery is an adaptation of Van Riper’s experiment to 
clinical requirements. It differs from Van Riper’s method in 
several important details. His subjects used actual words and 
numbers. In this study only nonsense figures are employed. 
Van Riper experimented with auditory, visual, and kinesthetic 
stimuli separately. We are interested mainly in the visual 
aspect, as this seems the most important from the clinical view- 
point. We utilize mainly eye-hand coordinations as they occur 
in writing, spelling, and reading. In Van Riper’s study the 
subjects were allowed to move their hands in opposing direc- 
tions. In this study they are forced to move both hands at 
the same time in the same direction. The non-dominant hand 
is thus forced to follow its leader. Van Riper’s critical angle 
board was tried out with a view to studying the degree of 
dominance, but was found to be unsatisfactory, as it made 
many subjects conscious of the conflict and interfered with the 
most important feature of the test, the almost complete un- 
awareness of the subject that he is mirroring with one hand. 
The degree of dominance is better measured by a large num- 
ber of ambigraph items than by the critical angle technique. 


DIRECTIONS FOR ADMINISTERING THE TEST 


The ambigraph battery includes two tests of eye preference, 
eight criterion performances of the traditional type, and fif- 
teen ambigraph drawings proper. They are administered in 
the following order. 

1. eye preference, manuscope, three trials. 

2. criterion performances. 

3. ambigraph drawings. 

4. eye preference, cardboard-hole, three trials. 

3 Van Riper, C., A New Test of Laterality, J. Exp. Psychol., 1934, 17, 


305-313, & Van Riper, C., The Quantitative Measurement of Laterality, 
J. Exp. Psychol., 1935, 18, 372-382. 
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1. The Manuscope Eye Preference Test. 


Materials: Conical-shaped sighting tube and a card with 
three drawings. §.* stands with back toward main source of 
light holding sighting tube, broad side up, in both hands. (E. 
should place tube in S.’s hands.) S8S.’s arms extend downward 
relaxed. E., with exposure card in his hands, places himself at 
a distance of about 10 feet from S., facing him directly, and 
says: ‘‘When I say up, I want you to bring the tube up to 
your eyes and look through it with both eyes at this card which 
I will hold in front of my face. When I say down, put the 
tube down again. I am going to let you look at the card three 
times, and after that I will ask you some questions about what 
you saw. Ready now, up!’’ As soon as E. ascertains the 
sighting eye, he should say ‘‘down,’’ permitting not more than 
two seconds fixation time. The sighting eye can easily be seen 
by looking at S. through the tube or by watching the deviation 
of the tube from the midline of S.’s face. Give three trials 
and record the sighting eye. The S.’s motor set may be 
changed by having him put the manuscope on the table be- 
tween trials. After the third trial E. may ask these questions. 
What did you see? Where was the largest circle?’ Which 
one was the darkest? etc. 


2. Criterion Performances. 

(a) Clapping Hands. Say: ‘‘Clap your hands.’’ If 8. 
moves hands sidewise, ask him to do it again moving his hands 
in the up-and-down direction. The hand on top is the domi- 
nant one. 

(b) Thumb Test. Say: ‘‘Clasp your hands like this.’’ 
(Demonstrate briefly, if necessary.) The thumb on top indi- 
cates the dominant hand. 

(ec) Twirling Thumbs. Say: ‘‘7'wirl your thumbs like this.’’ 
(Demonstrate briefly, if necessary.) The righthanded move- 
ment is clockwise when seen from S.’s right hand side, the 
lefthanded movement is counter-clockwise when seen from the 
same position. 


48. stands for Sub}. , E. for examiner. 
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(d) Writing. Say: ‘‘Write your name on this piece of 
paper.’’ Record the writing hand. 

(e) Catching Ball. Say: ‘‘Catch the ball,’’ as you throw it 
to S. Record the hand that covers the ball. If the catch is 
definitely sidewise, repeat the test with instructions to cover 
the ball with one hand. 

(f) Throwing Ball. Say: ‘‘Throw the ball back to me.’’ 
Record the throwing hand. 

(g) Holding Glass. Say: ‘‘Show me how you would hold 
the glass if you were to drink from it.’’ Record the holding 
hand. 

(h) Dealing Cards. Say: “‘Put these cards in two piles 
according to their color.’’ Record the sorting hand. 


3. The Ambigraph Tests. 

The ambigraph consists of an upright metal plate supported 
on two base plates. It is collapsible for convenience in trans- 
portation and handling. The open ambigraph should be 
placed on the table or desk in front of the standing subject so 
that the plane of the upright and the lateral plane of 8.’s body 
form a right angle. The main source of light should fall on 
S.’s back. Sheets of paper are slipped over the upright and 
fastened to it by means of the clip. Inexpensive copy type- 
writer paper may be used for the test. The dimensions of the 
upright are such that a half sheet of any standard typewriter 
paper, when folded in half, will fit its surface. 

Two procedures were experimented with in the administra- 
tion of the ambigraph drawings. They are equivalent as far 
as the final outcome is concerned. Both will be described here, 
although the simpler one has been found to be superior for 
clinical purposes. Both were used on about 400 cases each in 
the final standardization. The long method requires a sepa- 
rate sheet of paper for each ambigraph drawing. If both 
sides of the same sheet are used, at least eight half sheets are 
required for the entire test. Cut four typewriter sheets in 
half, fold the eight half sheets, notch them on one side, and 
slip them on the ambigraph so that the notched side is on S8.’s 
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right hand side. Remove the used sheet from the ambigraph 
before presenting the next item. The papers are put on the 
desk, one on top of the other, with the drawings facing up. 
After the first eight items have been given, the unused sides 
of the same sheets may be used for the remaining seven items. 
The eight sheets are folded against the first crease and slipped 
on the ambigraph again so that the unused sides are on the 
outside and the notched side on S.’s right hand side. This 
method permits scoring of the tests after the administration 
of all the drawings. The changing of the papers following 
each drawing is, however, time consuming, and a great deal of 
paper is wasted without making the results any more reliable 
or more valid. 

The short method cuts the time of administration in half 
and requires only one half sheet of paper, because all fifteen 
drawings are made on the same sheet. In this procedure the 
- tests must be scored as they are made. E. watches the actual 
tracing of the right hand and records ‘‘R’’ or ‘‘L,’’ depending 
on whether the exposed model and the actual drawing are the 
same in lateral orientation or whether they are mirror images 
of one another. 

Give S. two long well-sharpened pencils, one in each hand. 
The pencils should be of equal length, of the same make, and 
the same hardness of lead. Special pencils may be set aside 
for the exclusive use in the ambigraph tests. Examiner 
stands on S.’s right hand side during the entire performance 
and scores the drawings as they are made. A record blank 
illustrating the scoring of the entire battery is printed in the 
appendix. 

The exposure cards are held by E. at a distance of three to 
five feet from S. at the level of his eyes or somewhat above that 
level. Subject’s sagittal plane, an imaginary vertical line 
through the middle of the exposed card, and the upright plane 
of the ambigraph should form a straight line. This position 
should be maintained throughout the performance. E. should 
be sure that no marked shifts to the right or left occur in the 
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position of §., of the cards, or the ambigraph. Slight uncon- 
scious shifts of the body occur in almost all subjects and may 
in themselves be a clue to the preferred side. It is not neces- 
sary to correct slight deviations. 

Direct S. to place the pencils on the paper on either side of 
the upright. Then say: “‘I am going to ask you to write with 
both hands at the same time without looking down at the 
paper.’’ (Show first preliminary drawing—vertical line.) 
‘*Look at this line (make overt movements with finger along 
the line), it goes in the up-and-down direction. Make a line 
like this moving both hands at the same time in the same 
direction.”’ If necessary, warn S. not to look down at the 
paper, but to keep looking at the card. If the line is drawn 
incorrectly, repeat instructions and the test until the line is 
drawn vertically, using the same piece of paper for consecu- 
tive trials. If the line is drawn correctly, i.e., in the up-and- 
down direction on the ambigraph, present the second fore- 
exercise, the horizontal line. In presenting Item No. 2, say: 
“‘This line, you see, goes the other way. (Make overt move- 
ment.) Now, without looking at the paper, make one like this 
with both hands at the same time. Remember, this line goes 
the other way.’’ If necessary, repeat the test until the line is 
drawn horizontally on the ambigraph. E. may demonstrate 
the actual hand movements, should S. be unable to do it right 
despite several trials. Most subjects will have little difficulty 
in getting the idea. 

After the fore-exercises have been given, summarize the in- 
structions again as follows: ‘‘Now remember, all lines going 
this way (point to the vertical line again) should be drawn in 
the up-and-down direction, and all lines going this way (point 
to horizontal line again) should be drawn in the back-and- 
forth direction.’’ Then proceed with the other drawings in 
numerical order, always recording the orientation of each item 
immediately after it is completed. At first, it may be neces- 
sary to hold the exposure card against the right side of the 
ambigraph (from subject) to determine the orientation of the 
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design. If the model and the test performance are alike, 
score ‘‘R’’ (right). If the test performance is a mirror image 
of the model, score ‘‘L’”’ (left). See illustration below. There 























This illustrates the short method of administering the ambigraph tests. 
The card is held at 1, while 8S. is trying to draw what he sees. The card 
at 2 indicates the actual or imaginary position from which the response 
is scored. Both scorable drawings (3 and 4) are shown on the right side 
(from 8.) of the ambigraph. In the actual test situation, of course, only 
one of the two responses occurs at any one time. The response at 3 is 
scored ‘‘L’’ (left), because the right hand has drawn the mirror image 
of the exposed model. The response at 4 is scored ‘‘R’’ (right), because 
response and model are identical. All other drawings are given and scored 
in the same manner. 


is no time limit for the exposure of the drawings. Usually not 
more than five seconds are required for each item. The tests 
may be repeated as many times as is necessary. Despite the 
fore-exercises, inversions of 90 degrees may occur on some 
items. In such cases horizontal lines are drawn vertically and 
vice versa. ([] instead of —]) Since drawings inverted ex- 
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actly 90 degrees are not scorable, they should be corrected by 
repeated trials after S.’s attention has been directed to the 
vertical and horizontal lines of the drawing. The average time 
for. administering the entire battery, including the criterion 
performances and the eye preference tests, is about 12 minutes. 

The thirteen ambigraph drawings were selected as the most 
discriminating ones from twenty-eight items used in experi- 
ments involving individual examinations of 1290 children be- 
tween the ages of seven and sixteen. The tests were given in 
1934 and 1935 to a random sampling of children attending 
three Brooklyn Public Schools. 


4. The Card-Hole Eye Preference Test. 

Materials: Stiff cardboard 84 x 54, with hole in the middle 
14 square inch in size and exposure card with three circles 
on it. 

Directions for this test are the same as for the manuscope 
test, except that both arms are extended forward as far as 
possible while S. is looking through the hole, both eyes open, 
at the exposed card. Give three trials. Record the sighting 
eye each time. 


SCORING OF ALL TESTS 


As the items included in the ambigraph battery do not dif- 
ferentiate between right and left equally well, a weighted score 
was assigned each item on the basis of its diagnostic value. 
This was determined by an item analysis of the results of defi- 
nitely lefthanded and definitely righthanded children. The 
percentages of lefthanded responses for the two groups were 
found, the probable errors of the differences and their critical 
ratios computed. The ambigraph items were evaluated by 
reference to the criterion performances. Each item of the eri- 
terion performances was validated according to its per cent 
agreement with the total scores of 116 definitely lefthanded 
and 121 definitely righthanded children. The critical ratios 
are shown in Table 1. 

In scoring, only lefthanded responses are assigned weighted 
seores. The eye preference tests are assigned the following 


RELIES 
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TABLE 1 
Probable Error Ratios for Each Item of the Criterion Performances and 
the Ambigraph Drawings 
Criterion performance Ambigraph drawings 

Diff. Diff. 

—_ Tie 3 PEs. 
Clapping Hands .............. an 448 Three 1.9 
Crossing Thumbs ..................... 1.03 Four 5.0 
Twirling Thumbs .................. 2.65 Five 6.6 
Writing 5.94 Six 11.2 
Catching Ball ccm 5.47 Seven 3.4 
Throwing Ball ccc 4.63 Eight 6.0 
Holding Glass 0.0... - 2.98 Nine 6.8 
Dealing Cards ....ccccccccmemue 1,74 Ten 3.2 
Eleven 4.1 
Twelve 2.8 
,. a wr 
Ds.) a * | 
PE ninnctitenn i. 





weights. If all responses, both manuscope and cardboard, are 
lefteyed, score 3; if some are left and some right, score 1; if all 
six are right, score 0. The weighted scores for the criterion 
performances and the ambigraph items are recorded in Table 2. 






























































TABLE 2 
Weighted Scores for Lefthanded Responses on Criterion and 
Ambigraph Performances 
Criterion performances Ambigraph drawings 
Test Weight Test Weight 
Clapping Hands 2. ccccccnne 2 Three 1 
Crossing Thumbs .................... .. 1 Four 2 
Twirling Thumbs .................. 1 Five 3 
Writing 5 Six 4 
Catching Ball 2 # Seven 1 
Throwing Ball 3 §=Eight 2 
Holding Glass 2 # Nine 3 
Dealing Cards 1 Ten 1 
Eleven 2 
Twelve 1 
Thirteen 2 
Fourteen 1 
Fifteen 2 
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The weighted scores for leftsided responses on all tests are 
added to yield a total weighted score. The latter represents 
the degree of leftsidedness in the individual. The highest 
possible score is 45. The final results may be expressed in 
percentile ratings which are found in Table 3. The higher the 
percentile rank, the greater the sinistrality of the subject. 


Percentile Ratings for Total Weighted Scores 





























Weight Percentile Weight Percentile 
OD. savvesesaiciainshincioltoalindiiaia oe a 88 
1 4 TP ecithhsinnimnnibageasi 89 
a 6 A deritistainniaplscninine 91 
SE PL 10 UU Siliehaidibmedapicin cision 92 
4 15 SE dacsiniiesiecenisiisiies 93 
_ ae 19 27 .. 93 
IO shceacteruicdiatibiadladancetvaignteal 24 OD ctiirtmioncscerencenicinni 95 
i . 32 29 ... 96 
© na “ . 38 BO aiicicsipiite intend 96 
__ RNR Een enone 44 ae ere ee oe 97 

BOE itiidsbenctitinnsigihcinbeienanne 50 DUE | enckcunnapeteibinee 97 
1l 55 Oe snictnicpnnieampaliniiis 97 
| SRD a SRE Ae een 60 en oe 98 
| Seibiar Sensei s Eine URW 65 og eeCee 98 
14 68 OD censtibinnnd 99 
. ae 72 37 ... 99 
i iicscemtnnigsennla . 75 er 99 
17 78 Pe 99.5 
18 82 OP Riictiiiiettcicenen 99.8 
19 83 Bi aint insane 99.8 
DD wcicsssntietiitiasieiauictis 85 42 99.9 
BU nrostleonedibshiisbinionictbe 86 OE pincncntitbnite 100 





The eye preference tests are included in the total result 
because lefthanded children were found to be more frequently 
lefteyed than were righthanded children. While eye prefer- 
ence by itself may not be a valid sign of sidedness, together 
with other tests it expresses a definite tendency toward right 
or left dominance. Out of 820 cases examined with the manu- 
scope and the cardboard test (3 trials each), 458 or 55.8 per 
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cent were consistently righteyed, 298 or 36.4 per cent were 
consistently lefteyed, and 64 or 7.8 per cent had mixed 
responses. No significant age or sex differences were found. 


INTERPRETATION OF THE RESULTS 


The evaluation of the total laterality score is based on the 
working hypothesis that fifty per cent of all people are inher- 
ently leftsided and the other fifty per cent are inherently 
rightsided. The apparent prevalence of righthandedness may 
be explained by the fact that many born leftsiders are early 
trained to use their right hands in most activities. If the true 
incidence of lefthandedness among a random sampling of the 
population were somewhere between 5 and 10 per cent, then 
all tests here used should yield results falling within that 
range. Yet the results show enormous variations in lefthanded 
responses depending on the type of test used. Handwriting, 
being subject to careful and prolonged training, shows only 
5.2 per cent lefthanded children out of a group of 820. Over 
11 per cent of the children were lefthanded in throwing the 
ball and over 33 per cent caught the ball in a lefthanded man- 
ner. The lowest percentage of lefthanded responses on the 
ambigraph drawings was 19.8 per cent, the highest was 50.4 
per cent. While handwriting may be a valid test of individual 
sidedness, the items with the largest percentages of lefthanded- 
ness are more valid in the measurement of the incidence of 
potential sidedness. Table 4 contains a list of the percentages 
of lefthanded responses for each criterion test and each ambi- 
graph drawing. 

To render the percentile ranks meaningful, some sort of 
classification scheme of laterality must be adopted. This can- 
not be done without a theory of potential sidedness. Our 
hypothesis is that original sidedness, though a dichotomy, 
varies according to the principle of normal variability. In the 
majority of cases, the original differences between right and 
left are small. The number of cases becomes smaller as the 
differences between right and left increase, right domi- 
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TABLE 4 


Frequency of Lefthanded Responses for Each Criterion and 
Ambigraph Item 
N= 820 





Criterion performances Ambigraph tests 
Test % Left % Left 


Clapping Hands 

Crossing Thumbs 

Twirling Thumbs ....... ............. 
Writing 
Catching Ball 

Throwing Ball ..........cccccou 
Holdimg Glass i. ccs 




















nance representing one end of the curve and left dominance 


the other. The distribution of the laterality scores of this 
study is definitely skewed, but not bimodal.; The skewness is 
due mainly to the effect of training apparent in the criterion 
tests and also in some of the ambigraph drawings. The distri- 


TABLE 5 


Classification of Handedness Corresponding to Weighted and 
Percentile Ratings 





Weighted Percentile Interpretative 
score score classification 





0-1 1- 14 Very marked right preference 
2- 4 5- 15 Marked right prefernce 
5- 7 16— 32 Moderate right preference 
8-10 33- 50 Mild right preference 
11-14 51- 68 Mild left preference 
15-20 69— 85 Moderate left preference 
21-28 86-— 95 Marked left preference 
29-43 96-100 Very marked left preference 
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bution of the ambigraph results alone is considerably less 
skewed than that of the results of the entire scale. As it is 
difficult, at present, to find tests which would measure poten- 
tial sidedness apart from training, we have assumed that scores 
above the median essentially indicate leftsidedness. Table 5 
contains a scheme for classifying laterality based on the the- 
ory of normal variability. 

Van Riper reports contingency coefficients ranging from .73 
to .82 (with .866 perfect correlation) obtained by correlating 
tests and retests. The split-half method was used in calcu- 
lating reliability coefficients of the ambigraph battery. Cor- 
rected for attenuation, the values range from .67 to .84. The 
correlation between the criterion performances and the ambi- 
graph drawings was found to be .438. It is apparent that the 
ambigraph tests measure a somewhat different aspect of sided- 
ness than do the criterion performances. 

The ambigraph laterality battery measures potential sided- 
ness more accurately than any other test known to the writer. 
It is far from perfect, however. Its ultimate worth depends 
not only on the effectiveness with which each item differenti- 
ates between right and left, but also on how closely the distri- 
bution of its total scores approximates normal variability. 
With this in mind, the writer has tried, during the past four 
years, to find ways of improving the scale. Several changes 
have suggested themselves. A rearrangement of the order in 
which the ambigraph drawings are presented and slight 
changes in the administration may lead to very significant 
increases in the validity of the tests. The number of criterion 
performances may be increased, particularly by items less sub- 
ject to training than those of the present series. The results 
of the criterion performances and those of the ambigraph 
drawings may be interpreted independently to get a discrep- 
ancy value which may reveal the degree of conflict between 
peripheral training and central dominance. In any revision 
of the tests the materials will remain essentially the same. The 
directions of administration and the norms will change. 
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APPENDIX 
RECORD BLANK—AMBIGRAPH LATERALITY TEST 
Name John Smith Sex M Color W Cron. Age 8 
School Grade 3rd Classification Marked left preference 
Date of Test 12-21-1938 Examiner T. R. 
1. Eye preference Response Weight 
Manuscope (3 trials) 0... RE RE 
LLL 
Card-Hole (3 trials) ....cccccccoooom RB EB 
LL iL 0-1-3 
2. Criterion performances 
Clapping Hands R L 2 
Crossing Thums. .cccccccccccncnmnn RL 1 
Twirling Thumbs 000m RL 1 
Writing BL 5 
Catching Ball RL 2 
Throwing Ball RL 3 
Holding Glass R L 2 
Dealing Cards R.L 1 
3. Ambigraph drawings 
Three RL 1 
Four R L 2 
Five R L 3 
Six RL 4 
Seven RL 1 
Eight RL 2 
Nine RL 3 
Ten RL 1 
Eleven RL 2 
Twelve BL 1 
Thirteen R L 2 
Fourteen RL 1 
Fifteen RL 2 
Total Weight Score nn ccccccccmenn 21 
Percentile Rating ...:ccccccccorcercvceneens 36 


-_—- 


Letters in black face indicate the actual responses made. 
Weights corresponding to lefthanded responses are added to 
yield the total weighted score of 21. In actual practice, the 
responses and weights are encircled on the score sheet. 











VOCATIONAL INTEREST FACTORS 
IN WOMEN 


W. J. E. CRISSY anp W. J. DANIEL 
University of North Carolina 


HURSTONE (1) has made a factorial analysis of the 
Strong Vocational Interest Blank for Men, using an 
intercorrelation matrix of eighteen vocational interest 

categories. The factors he obtained he called: 1. Interest in 
Science, 2. Interest in Language, 3. Interest in People, 4. In- 
terest in Business. Reference to Table 4 indicates the three 
vocations which are most characteristic of each of these factors 
and the three which are least characteristic of each of these 
factors. To illustrate: the Business factor operates most 
prominently in Real Estate Selling, C. P. A., and Life Insur- 
ance Selling—it operates least prominently in Y. M. C. A. 
Secretary, Art, and Ministry. 

The writers computed from Thurstone’s data the amount of 
the total communality* accounted for by each of the Thurstone 
factors. These percentages are given in parentheses following 
the names of each of the factors in Table 4. For example, it 
will be noted that the Business factor accounts for 13 per cent 
of the total communality. 

To determine whether similar factors were basic to women’s 
vocational interests, the writers applied the Thurstone centroid 

*To define communality it is necessary to remember that any test is 
composed of (1) communality, (2) uniqueness and (3) error. The com- 
munality of a given test is the amount of that test accounted for by all 
the factors present in the test. Likewise the communality of a given fac- 
tor is the sum total of that factor’s contribution to all the tests. The 
total communality is (a) the sum total of all the test communalities or 
(b) the sum total of the factor communalities. Thus the percentages 
reported are ratios of the respective factor communalities to the total 
communality. The percentages may be looked upon as indices of the im- 
portance of the factors. To see this illustrated consult Table 3. The h2 
column exemplifies (a); the h? row exemplifies (b). 
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factorial procedure to the intercorrelations of Strong scores 
for women reported by Strong in the manual for the test (2). 
These correlations are reprinted in Table 1. 

The centroid factors obtained from the solution are reported 
in Table 2. The mean residual after the fourth centroid fac- 


TABLE 2 
Centroid Factors and Communalities 



































I II III IV h2 
1. Author -.71 61 33 .02 99 
2. Librarian -.69 54 .07 aan .78 
3. Artist -Al 80 .20 25 91 
4. Physician —.36 52 -65 -.07 83 
5. Dentist 58 40 -56 12 82 
6. Life Insurance Saleswoman ...... -.09 -.13 25 -.59 44 
7. Social Worker -78 -29 -27 -.24 82 
8. Teacher of English ......................... -61 -43 .20 51 88 
9. Teacher im Gemeral on....ccccccccccon -—38 -56 -.27 50 .78 
10. Teacher of Social Sciences .......... -—27 -83 -.26 17 89 
11. Lawyer -43 -50 -24 -.49 -73 
12. Y. W. C. A. Seeretary ..................... -21 -.74 -35 -.06 72 
13. Teacher of Math. & Physical Sci. 39 -24 -,68 35 .78 
14. Nurse 66 -29 24 16 .60 
15. Secretary-Stenographer ................ 74 -A2 43 -.07 91 
16. General Office Worker ...................... 84 —44 21 -14 96 
17. Housewife 85 —33 24 12 90 
18. Masculinity-Femininity ................. 15 31 -27 -.26 26 


h2 5.64 454 227 1.56 14.02 





tor was removed together with the P. E. of the distribution of 
residuals was .001 + .04. In Table 3 the rotated factors are 
reported. To obtain the latter a graphical procedure was 
used rather than the more elaborate computational procedure 
reported by Thurstone (3). 

An error of 1 per cent resulted from the graphical rotation. 
This percentage was computed by taking the difference be- 
tween the total communality resulting from the centroid fac- 
tors and the total communality obtained from the rotated 
factors, and dividing this difference by the first of these total 
communalities. 
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TABLE 3 
Rotated Factors and Communalities 





M.A. P. L. 8. h2 





























1. Author . -—84 -28 34 -27 97 
2. Librarian -—74 --.20 42 -.03 .76 
3. Artist -62 -.61 37 ©-.07 .90 
4. Physician -55 -—12 13 -70 82 
5. Dentist 28 -46 -.21 .68 .80 
6. Life Insurance Saleswoman. ........ —.26 29 -42 -27 40 
7. Social Worker -.50 .69 -25 | .80 
8. Teacher of English ....................... —.03 38 76 -.35 85 
9. Teacher im Gemeral] ........ccccccoccsscccss 24 50 .67 ll .79 
10. Teacher of Social Sciences ............ 38 .78 32 .05 .86 
11. Lawyer —.25 80 -14 .08 .73 
13. Y. W. OC. A. Seeretary ......... 23 .78 12 16 -70 
13. Teacher of Math. and Phys. Sc. 58 .08 13 65 .78 
14. Nurse 72 -03 -.20 .29 64 
15. Secretary-Stenographer ................. 71 -03 -42 -.45 88 
16. General Office Worker ..................... 77 02 -57 -.22 97 
17. Housewife 83 --16 -.36 -.22 89 





18. Masculinity-Femininity ................. -16 -.16 -.30 35 -.26 


h2 5.32 3.55 2.68 2.22 13.82 





M Male Association. 


3 People. 

L. Language. 

8S. Science. 

h2 Communality. 

The writers have tentatively named the rotated factors In- 
terest in Male Association, Interest in People, Interest in Lan- 
guage, and Interest in Science. Table 4 presents a briefer 
picture of each of these factors than does Table 3. Thus it 
will be noted that the Male Association factor has heavy posi- 
tive loadings on Housewife, General Office Worker, Nurse and 
Secretary-Stenographer. Heavy negative loadings on this 
factor are found on Artist, Librarian and Author. 

The People factor shows close correspondence to Thurstone’s 
People factor and has heavy positive loadings on Lawyer, 
Y. W. C. A. Secretary and Teacher of Social Science; it has 
negative loadings on Author, Dentist and Artist. One diver- 
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gence between our People factor and Thurstone’s is that his 
People factor has a slightly negative loading on Lawyer as 
opposed to our heavy positive loading on Lawyer. However, 
the women lawyers making up Strong’s validating sample are 
from ‘‘larger cities of the country’’ and they might well be 
workers in juvenile delinquency, marital adjustment and other 
more social aspects of legal administration. This might ac- 
count for the positive loading of Lawyer on our People factor. 

Our Language factor is characterized by heavy positive load- 
ings on Teacher of English, Teacher in General and Librarian. 
It has negative loadings on Life Insurance Saleswoman, 
Secretary-Stenographer, and General Office Worker. This 
might perhaps also be looked upon as a Professional-Non- 
Professional factor. 

The fourth factor, Interest in Science, has positive loadings 
on Physician, Dentist, and Teacher of Mathematics and 
Physical Science. It has negative loadings on Author, Life 
Insurance Saleswoman, Teacher of English, and Secretary- 
Stenographer. This factor shows a close correspondence to 
Thurstone’s Science factor. 

Our Male Association factor accounted for 38 per cent of 
the total communality. Our People factor aceounted for 25 
per cent of the total communality in contrast with Thurstone’s 
People factor which accounted for 17 per cent of the total 
communality in male subjects. Similarly our Language factor 
accounted for 21 per cent of the total communality in contrast 
with Thurstone’s Language factor accounting for 29 per cent 
of the total communality in male subjects. Finally, and per- 
haps most important, our Science factor accounted for 16 per 
cent of the total communality as opposed to Thurstone’s 
Science factor which accounted for 41 per cent of the total 
communality. 

It will be noted in Table 1 that in addition to the seventeen 
vocational interests there is also a Masculinity-Femininity 
scale. This scale shows positive (Masculine) loading on 
Science, negative (Feminine) loading on People and Male- 
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Association ; and more markedly negative (Feminine) loading 
on Language. 
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ADULT NORMS FOR THE K-S CLINICAL 
FORMBOARDS 


DAVID SHAKOW 
AND 


BESSIE PAZEIAN* 
Worcester State Hospital 


N 1928, Kent and Shakow (1) reported a new series of form- 
boards which was a further development and partial sub- 
stitute for the earlier Worcester Formboard Series. The 

new series was constructed in two models, essentially the same 
in design but differing in size. It was suggested that the smaller 
model would find its greatest use in the clinical field, whereas 
the larger might have its greatest usefulness in the industrial 
field. These soon became known as the ‘‘Clinical’’ and ‘‘In- 
dustrial’’ models, respectively. 

When the K-S Formboards were first offered for use, an ade- 
quate method of evaluating results had not been developed. 
Later, tentative norms—never published—were established for 
the Clinical model on the basis of work done with children. 
However, because of the frequent use of the series with adults, 
the need for adequate adult norms was recognized. The pres- 
ent paper is concerned with the presentation of such norms for 
the Clinical model. 

Four groups of subjects were available : samples of males and 
females taken to be fairly representative of the adult popula- 
tion (to be referred to as ‘‘adult’’ in the ensuing discussion) 
and samples of males and females taken from the upper range 
of the educational distribution (to be referred to as ‘‘superior 
adult’’ in the ensuing discussion). The adult groups were 
selected to meet approximately the occupational and educa- 
tional levels of the general population of the age range in 

* From the Research Service of the Worcester State Hospital, Worcester, 
Massachusetts. 
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which they fall. The superior adult groups consist of subjects 
who, with few exceptions, have had some college education and, 
who, on the basis of language tests, indicated that they belong 
in this classification. 

TABLE I 


Means and Standard Deviations of Chronological Age and Education for 
the Various Groups 











‘ Education 
Group N nr gen (grade completed) 

Range | Mean | 8.D. | Range | Mean | 8.D. 

Male adult .......... | 91 | 16-38 | 216 | 53 7-18 | 10.8 | 3.1 

Female adult ..... 120 | 16-36 | 185 | 4.2 7-18 | 10.0 | 3.2 
Male superior 

adult 64 | 20-45 | 264 | 45 | 14-22 | 174 | 1.1 
Female superior 

SED ccectsstbews -| 80 | 16-55 | 25.2 | 66 | 11-19 | 162 | 12 


























Table I gives the constants for chronological age and educa- 
tion for the four groups. Although the subjects are concentrated 
in the third decade, it is probable that the norms are at least 
approximately valid for persons up to 40 and perhaps 50. Be- 
yond this level it is expected that age would become a factor 
to be seriously considered as to its possible effect on the 
results (2). 

The instructions used in the administration of the test are 
as follows: 


E (examiner) and S (subject) are seated at opposite sides of a table 
with the frame before 8 so that the horizontal figure is nearest him. The 
box containing the blocks should be at E’s side, where S cannot see it. 
(This is done so that S cannot tell if the series has been discontinued 
without completing it.) 

E places blocks for 28 out on the table within S’s easy reach but so 
that the formboard is between the blocks and 8 and says, ‘‘ Let’s see how 
quickly you can fit these blocks into their places, two blocks for each hole.’’ 
The time it takes S to complete the task is recorded and the blocks are then 
returned to the container, leaving the frame ready for the next task. 

When placing the blocks for the second task, 2D, E says, ‘‘ This time, 
again, there are two blocks for each hole. See how quickly you can put 
them into the frame.’’ 
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For each trial 8 is informed how many blocks there are for each recess, 
but no mention of speed is made after the second task; timing should be 
unobtrusive. 

Blocks are shuffled and placed before S at random save that on 2D, 
where a block in each figure should be reversed so that S has to make 
adjustments in turning and placing the blocks. No two adjacent blocks 
should be placed together in any task. 

The tasks are presented in the following order: 28, 2D, 38, 8D, 48, 
4D, 4DD, 5D, until 8 fails either by giving up or by exceeding the time 
limits as given in Table II. Failure in any diagonal task indicates S’s 
limits in the diagonal series, but he should still be permitted to try 
another task of the straight series, if there are any such left. An S who 
loses credit on 3D by exceeding the time limit may yet be able to score 
on 48. In giving task 5D, E says, ‘‘ This is the last one. There are five 
pieces this time. Go ahead.’’ 

Although no credit is given for a performance that passes the time limit, 
S should be permitted, if there are indications that he can, to finish the 
task unaided or he may be given just enough assistance to enable him to 
complete it. It is permissible to warn S early in the series that the 
tasks become progressively harder, and to explain that it is expected that 
he will require more time as the series progresses. On no account should 
he be permitted to know how many tasks there are, nor to suspect that 
there are any time limits. Whatever the quality of the performance, the 
test should leave S with a sense of achievement rather than a sense of 
failure. 


The new norms in terms of decile ranks (Tables II, III, IV, 
V) refer to time-scores of each of the four groups. (The upper 
limits in time are those given in the tables.) Since some of the 
simpler tasks, namely 2S, 3S, and 3D, have areas in which the 
discrimination between deciles is probably no greater than the 
error of measurement, the norms have been telescoped at these 
points—indicated by asterisks in the tables. Because of some 
changes in the time limits, in those cases where the limits have 
been extended it has been necessary to make some extrapolations 
to take care of this extension. These values should, of course, 
be given lesser credence, although it is believed that the errors 
introduced are not great. (See Tables IT, III, IV, V.) 

The scoring is as follows: From the appropriate table of 
norms, adult male or adult female (or at the discretion of the 
examiner in the case of subjects of college level or higher— 
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superior adult male or superior adult female) the respective 
decile rank of the time taken by the subject for each task is 
noted. The final score is the mean of all decile ratings ex- 
cepting that for 28. The latter is not included since the task 
is considered a preliminary one serving the purpose of a ‘‘shock- 
absorber.’’ Each mean decile rank is thus the mean of the 
ranks of seven tasks. Failures, beyond time-limit or beyond 
first decile limit achievements are given ranks of zero (0) for 
purposes of computation. The divisor is always seven. The 
time-limits are based on the achievement of the poorest group— 
adult female—and are therefore in some instances longer than 
necessary for the other groups. 

The examiner may, at his discretion, obtain two further 
scores by dividing the series into tasks of two kinds.’ The first, 
or ‘‘dexterity’’ group, is composed of tasks 2D, 38, 48. The 
‘*dexterity’’ rating, based, as it is, on tasks which for adults 
involve manipulative skill almost entirely, is the mean of the 
decile ranks of these three tasks. The second rating, that for 
a ‘‘capacity’’ group, consisting of tasks 3D, 4D, 4DD, 5D, 
which primarily involve more complicated form analysis, is the 
mean of the decile ranks of these four tasks. The divisors 
three and four respectively are held constant in all these com- 
putations. 


SUMMARY 


New norms and a scoring system for the K-S Clinical Form- 
boards are presented for four groups of adults. The scoring 
is given in terms of decile ranks derived from time scores. 
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1. Kent, G. H., anp SHakow, D. Graded Series of Formboards. 
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1Dr. L. Teegarden, in an unpublished study of the K-S Industrial 
Formboards which she has kindly permitted us to see, has found this 
method useful. 








THE REPETITION OF CLASSICAL EXPERI- 
MENTS: I. STARCH’S DISTRIBUTION 
OF PRACTICE 


LYLE K. HENRY anp RUTH WASSON 
Iowa State College 


INTRODUCTION 


VERY field has its list of classical literature of articles and 
E experiments that are known to all competent workers in 
that field. In the field of the psychology of learning 
three of these classics are: Learning in Telegraphy by Bryan 
and Harter,’ Motivation in Learning by Book and Norvell ;? and 
the Distribution of Practice by Starch.* Practically any in- 
troductory or educational psychology text that one would pick 
up today would contain reference to these experiments. 

If one examines a number of these classical experiments he 
is likely to be impressed with two things. First, since they are 
standard references, they are frequently fifteen to forty years 
old, and therefore do not employ recent research techniques 
which are now considered essential. Second, many are based 
on a very small number of subjects, possibly as few as one or 
two persons. The question arises, ‘‘Are these results reli- 
able?’’ Would one get similar results if he repeated the 
experiment? 

With this thought in mind the decision was reached to re- 
peat, as nearly as possible, some of these experiments to test 
their reliability. While the tendency in research seems to be 
for original work the writers contend that a respectable con- 

1 Bryan, W. L., and Harter, N., Studies in the Physiology and Psy- 
chology of the Telegraphic Language. Psychol. Rev., 1899, 6, 348-375. 

2 Book, W. F., and Norvell, L., The Will to Learn. Ped. Sem., 1922, 29, 
305-62. 


8 Starch, D., Periods of Work in Learning. J. Educ. Psychol., 1912, 3, 
209-213. 


503 





504 LYLE K. HENRY AND RUTH WASON 


tribution to science might be made by independent investiga- 
tors doing identical experiments. 


YY OOO ©O® 
OO OYA ® OOO 


OO ®DOOOOO 





FicurE 1. The Experimental Task as Taken from Starch. 
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THE EXPERIMENT 


The attempt was made to duplicate the experiment on dis- 
tribution of practice as performed by Starch. The material 
was mimeographed on 84” x11” paper as shown in Figure 1. 
The task was to substitute numbers for letters according to the 
code at the top of the page. The subjects worked a total of 
120 minutes, the variable being the distribution of practice. 
Table 1 shows the number of subjects for each type of dis- 
tribution both for Starch’s experiments and ours. 


TABLE 1 
The Experimental Groups 





Practice Period in Minutes ............... 10 20 40 120 Total 
Number of Subjects Starch. .............. 12 14 9 7 42 
Number of Subjects Ours ................... 9 14 7 10 40 





The experiment was performed during one \veek of the 
regular school year. The subjects were students in Ele- 
mentary Psychology and did the experiment at home for extra 
credit. The 10 minute group worked for 10 minutes, twice a 
day, for six days; the 20 minute group once a day for six days; 
the 40 minute group worked three times on alternate days and 
the 120 minute group worked two hours in one sitting. The 
subjects kept their own time and recorded where they were 
working at the end of each five minute period. 


RESULTS 


The averages for each 5 minute period are shown in Table 2. 
It will be noted that the 40 and 120 minute groups had the 
highest scores on the first two periods. It is hardly likely that 
the final superiority of the 10 and 20 minute groups can be 
attributed to superior initial ability. 

Probably the best way to compare our results with those of 
Starch is by the graphs in Figure 2. One is at once impressed 
by the general similarity of the two groups of curves. It will 
be noted, however, that our groups are more nearly equal in 
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TABLE 2 
Average Scores for Each Group for Successive Five Minute Periods 





Group 1 2 3 4 5 6 7 8 . “oe es (38 


10 .. 79 94 105 124 118 138 135 151 166 163 187 186 
20’... 80 100 109 121 130 128 139 147 160 157 177 174 
40’ .. 90 113 118 130 125 136 123 133 134 141 151 154 
1207 .. 89 104 109 120 122 125 128 130 141 124 131 127 








Group 138 14 15 16 17 18 19 20 21 22 23 2 


10’ ..196 198 215 218 212 222 227 236 239 264 240 267 
20’ ..179 182 185 191 193 189 192 200 215 203 212 209 
40’ ..161 161 169 164 184 187 182 187 181 179 185 197 
120’ ..133 133 132 138 143 132 135 137 132 133 140 138 








ability for the first six of the 5 minute periods than are those 
of Starch. Since Starch’s groups showed marked differences 
so early in the experiment the question might arise as to signi- 
ficant differences in initial ability. For example, in Starch’s 
data, the 120 minute group was lowest for every period while 
the 10 minute group was the highest on every period except 
the first. This gives the impression that the value of short 
practice periods shows up immediately. Our data indicate 
that noticeable differences between groups do not show up 
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Figure 2. Graphica) Comparison of Data. 
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until the sixth or eighth five minute period. Another differ- 
ence in the data will be noted for the 20 minute group. 
Starch’s group achieved a level almost equal to the 10 minute 
group while we found the efficiency of the 20 minute period 
to be more nearly like the 40 minute period. 


SUMMARY AND CONCLUSIONS 


The purpose of this experiment was to repeat Starch’s class- 
ical experiment on the distribution of practice for the pur- 
pose of testing the reliability of the results. The following 
conclusions were reached : 

1. Our results confirm the general findings of Starch; the 
shorter periods are more favorable for learning this type of 
material. 

2. Contrary to Starch’s data, we do not find definite superi- 
ority of the shorter periods until about the tenth five minute 
period. We believe the very early superiority of the shorter 
period groups suggests the possibility of initial superiority. 

3. Contrary to Starch’s data, we find the 20 minute practice 
period to be more like the 40 minute period than the 10 
minute period. 





SOME ASPECTS OF SOCIAL ADAPTABILITY 
AMONG ADOLESCENTS 


CHARLES C. GIBBONS 
Ohio State University 
AND 


JAMES P. PORTER 
Ohio University 


STATEMENT OF PROBLEM AND PREVIOUS STUDIES 


OME of the investigations that seem to bear directly on 
social adaptability will be considered. In 1904, Terman 
(11)* found that there were certain qualities noticeable 

among the best-adapted pupils and that there were certain 
other qualities noticeable among the poorly-adapted pupils. 

Symonds’ analysis of tact (10) is closely related to the 
problem of the present investigation. Symonds’ analysis of 
tact is more an analysis of tactlessness, for he lists 1173 acts 
which indicate an absence of tact. For each act he gives a 
numerical index of frequency of occurrence and an index of 
the amount of annoyance which the action causes when it oc- 
curs. These indices were computed from the ratings of forty- 
six persons. Symonds gives the product of these two indices 
as an indication of the importance of the action in social 
adjustment. 


PROCEDURE AND RESULTS 


The present investigation was aimed at getting the relation- 
ships between the following measures of the adolescents in- 
cluded in the study : 


(1) Rating in adaptability by teachers. 

(2) Rating by fellow students. 

(3) Intelligence quotient. 

(4) Ability to select, on a pencil-and-paper test, the ‘‘best’’ 
and ‘‘worst’’ courses of action in difficult social situa- 
tions. 


1 Numbers in parentheses refer to entries in the bibliography. 
508 
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THE SUBJECTS 


The subjects of the study were one hundred in number. 
A group of twenty boys and girls was used in each of four 
rural consolidated high schools and in the Friends’ Boarding 
School of Barnesville, all located in south-eastern Ohio. The 
superintendent of each school was asked to name ten boys and 
ten girls who would constitute a group that he would judge 
to be heterogeneous with respect to social adaptability. 


RATINGS BY TEACHERS 


The investigation was carried on in high schools whose enroll- 
ments ranged from one hundred to one hundred fifty pupils 
so that the teachers would know the pupils rather intimately 
and so, presumably, would be able to rate the pupils in adapt- 
ability with considerable validity. Experience has shown the 
value of ratings by associates. Soderquist (8) states that 
rating by associates is a more valid measuring device than 
pencil-and-paper tests. Another opinion expressed (9) is 
that verbal tests have very obvious limitations as measures of 
behavior, that performance tests must be artificially forced in 
order to yield objective scores, and that ratings by associates 
are better measuring tools. 

The rating method used in the present investigation was 
the method of paired-comparisons. By this method, the rater 
makes a separate judgment in comparing each person in the 
group with every other person in the group. For a group of 
n individuals, as many comparisons must be made as there are 
combinations of n things taken 2 at a time. The formula is: 


_n(n-1) 
nC2 — 2 
For a group of twenty, as in the present study, mt?) or 190 





2 

separate comparisons are required. The administration of this 
rating method was simplified and accelerated by the use of a 
set of one hundred ninety cards, corresponding to the one hun- 
dred ninety comparisons that were to be made. Each card 
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contained the numbers of the two students who were to be com- 
pared. The names of the students corresponding to these num- 
bers were read from a separate sheet by the experimenter. The 
following directions were read to the group of six teachers in 
euch school: ‘‘We are asking you to rate twenty of your stu- 
dents in tactfulness, adaptability, or ability to get along with 
people.? In order to make the ratings more reliable and easier 
for you, you will consider just two students at a time. I shall 
read the names and numbers of two students and you are to 
write down on your papers just the number of the student who 
you think is more tactful, more adaptable, or has more ability 
to get along with people. Do not consider intelligence or 
ability to do school work.’’ 

The rating process required from thirty to forty minutes. 
Ten days after the first ratings, the process was repeated in 
four of the five schools. 

The characteristic of ratings which is investigated most 
often is reliability. Since the ratings were repeated in four 
of the five schools, it was possible to compute a coefficient of 
reliability for the ratings. It was .96+ .01. In addition to 
this high coefficient of reliability, there are other factors to 
indicate that the paired-comparison method is a good rating 
device. Langlie (3) states that when the graphic rating 
seale is used, there is a tendency for certain teachers to rate 
everyone either high or low. Such constant errors cannot 
enter into paired-comparison ratings. Another advantage of 
the paired-comparison method is that the rater is not aware 
of the rating which he is assigning to each subject. This rat- 
ing is computed later from the one hundred ninety choices 
which each rater makes in rating the twenty persons. 

Langlie (3) states that, other factors remaining constant, 
that rating system is the weakest which yields the highest cor- 
relations between obviously unrelated traits. In the rating 
procedure, a number was assigned to each subject. When 


2It may be one of the limitations of this study that the description 
of the trait was too general. 
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.two subjects were to be compared, their names and numbers 
were read to the raters and each rater wrote on his paper the 
number of the person whom he rated higher in the trait. What 
relation would exist between a person’s number and his total 
rating? Obviously, there would be no justification for a large 
correlation in this case, and by Langlie’s criterion a rating 
method which yielded a high correlation here would be weak. 
The correlation between the number the person had in the rat- 
ing procedure and the rating he received was —.01 + .07. 

A characteristic of ratings that is seldom investigated is 
the amount of disagreement among the raters as to what each 
subject’s rating should be. In order to understand how the 
amount of disagreement was computed in the present study, 
one must first understand how each subject’s rating was com- 
puted. Each rater compared every subject with every other 
subject in the group, as described above under ‘‘Ratings by 
Teachers.’’ The number of times a rater preferred a subject 
to any other member of the group was taken as the rating for 
that particular subject. A subject’s average rating was the 
arithmetic mean of his ratings by all the judges. 

The extent to which a rater disagreed with the rest of the 
raters in judging a particular subject was indicated by the 
difference between his rating of the subject and the subject’s 
mean rating. The mean value of all these differences indicated 
the extent to which a rater disagreed with his fellow-raters. 
Thirty raters were included in this study. The smallest mean 
difference was 1.45. The ratings of the rater who was in 
closest agreement with his colleagues differed on the average 
by 1.45 points from the mean ratings of the subjects. The 
corresponding figure for the rater in greatest disagreement 
with his colleagues is 4.24 points. Such a large amount of 
disagreement for a certain teacher might indicate that the 
teacher approves or disapproves of certain pupils without 
regard for their true worth. There was closer agreement 
among the raters in the boarding school than in the public 
high schools. Probably this closer agreement results from the 
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more frequent and more intimate pupil-teacher contacts in a 
boarding school. 

This analysis of disagreement in ratings can be extended 
to include the amounts of disagreement shown in rating sub- 
jects who possess different amounts of the trait. The one hun- 
dred subjects rated were divided on the basis of their average 
ratings into those rated in the highest fourth of the distribu- 
tion, those in the lowest fourth, and those in the middle fifty 
per cent. The results showed less disagreement on those rated 
lowest than on those rated highest, and less disagreement on 
those at the extremes of the distribution than on those in the 
middle of the distribution. 


RATINGS BY PUPILS 


After the twenty students in each group had assembled, the 
following statement was made: ‘‘Suppose that this summer 
you are going to California, driving your own car and camp- 
ing out along the way. Write on your paper the names 
of the three students in this group that you would like most to 
take with you. Then write the names of the three students 
that you would be most certain to leave behind. Feel perfectly 
free in making your choices, for no one in this school will ever 
see your paper.’’ 

One initial factor in favor of this method of rating is that 
the students seemed to enjoy it. In order to arrive at a num- 
ber to represent a student’s rating by the other members of 
his group, the number of times he was chosen to be left behind 
was subtracted from the number of times he was chosen to 
be taken on the trip. This number was taken as a rough indi- 
cation of the popularity of the student. This rating technique 
is not a new one. G. B. Watson (13) suggested such a pro- 
cedure in 1927 when he wrote: ‘‘The children in a group may 
be asked to tell which children they would like to invite to a 
party, which are their best friends, ete. The extent to which 
an individual is chosen by his friends is surely the most valid 
possible measure of his popularity and social status.’’ 
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One of the most interesting aspects of pupils’ ratings of 
each other is the extent to which these ratings correlate with 
teacher’s ratings of the same students. The coefficient of 
correlation, based on one hundred cases, is .69 + .04. It is 
noteworthy that teachers and pupils agree on any matter to 
this extent. 


INTELLIGENCE 


It was possible to determine the intelligence quotient of 
just sixty of the hundred subjects in this study. Forty of 
them were tested by the Kuhlmann-Anderson test and twenty 
by the Otis Self-Administering Test of Mental Ability (Higher 
Examination). 

It is important to examine the relationship between teachers’ 
ratings and intelligence. Soderquist (8) uses a low correla- 
tion between ratings and intelligence as evidence for the 
validity of the ratings on the theory that the low correlation 
indicated that the halo of academic success had not influenced 
the ratings. The correlation between ratings by teachers and 
IQ for sixty cases in the present study is .37+ .07. This 
low correlation may mean that, in keeping with the directions, 
the teachers did not allow the pupils’ intelligence to enter into 
their ratings. It is possible, however, that the correlation 
between the ratings and intelligence test scores would have 
been no higher than .37 if the teachers had been instructed 
to rate intelligence (1). 


SOCIAL RELATIONS OR TACT TEST 


The last ability measured was the ability to select the best 
course of action in a difficult social situation. An attempt was 
made to measure this ability so that we could determine what 
relationship exists between such ability and (1) age, (2) sex, 
(3) intelligence, (4) ratings in adaptability by teachers, and 
(5) ratings by fellow-students. 

The problem situations were suggested by one hundred col- 
lege students enrolled in Introductory Psychology. About 
one-third of the difficult social situations that were suggested 





514 CHARLES C. GIBBONS AND JAMES P. PORTER 


dealt with forgetting someone’s name. Forty-five of the dif- 
ficult social situations were selected as being most suitable 
and were presented in mimeographed form ‘to fifty high school 
seniors. The seniors were instructed to write below the 
description of each situation the course of action which they 
would follow. In this way a great many possible solutions 
were obtained for each situation. 

Three of the forty-five situations were discarded because 
there was so much agreement on the solution. For each of the 
remaining forty-two situations four courses of action were 
chosen : one that seemed to be the best solution, one that seemed 
to be a very poor solution, and two falling between these two 
extremes. 

It is apparent that the value of these situations as measur- 
ing devices is limited by the fact that the situations are verbal 
rather than behavioral. It seems reasonable to assume, how- 
ever, that a person who can choose the best course of action 
for a particular situation is at least somewhat more likely to 
actually follow the best course of action than a person who 
cannot make the correct choice. The choosing of solutions to 
these difficult social situations seemed to be a performance 
worth measuring. The only descriptive title on the test as it 
was administered was the question, ‘‘What would you do?’’ 
For convenience in this article, the test will be referred to as a 
Tact Test. The only justification for the name is that these 
situations and courses of action strongly suggest Webster’s 
Collegiate Dictionary definition of ‘‘tact’’: ‘‘—nice discern- 
ment of the best course of action under given condition, espe- 
cially ability to deal with others without giving offense.’’ 

A scoring key for the Tact Test was constructed on the basis 
of Tact Tests filled out by four university administrators and 
by four persons who have published books in the field of human 
relations. 

The Tact Test was administered to the five groups that 
have been described above. Ten days later the test was given 
again to determine the reliability of the test. The coeffi- 
cient of reliability of the test was .74 + .03. 








\) 





SOCIAL ADAPTABILITY AMONG ADOLESCENTS 515 


Statistically, a test is reliable if it measures consistently 
whatever it measures. A test is reliable insofar as it places 
the persons of a group in the same relative positions on two 
different administrations of the test. Another meaning of test 
consistency should be considered. A person may be said to 
respond ‘‘consistently’’ if he responds in practically the same 
way when certain stimuli are presented two or more times. 
The coefficient of reliability of a test is not necessarily an 
accurate measure of this type of consistency. 

The coefficient of reliability indicates how consistently the 
test placed the individuals within the group on two different 
occasions, but it does not measure the consistency with which 
the subjects responded to the individual items. To every item 
of a test, a person could respond differently the second time 
than he had the first time he took the test, and still receive the 
same total score. If all the members of a group performed in 
this way, then the test would possess high statistical reliability 
but there would be no consistency of item responses. The 
authors propose that tests should be examined for consistency 
of response; 1.¢., on how many items do persons taking the 
test a second time make the same responses as they did 
the first time? For the Tact Test the average number of 
changes was 9.7 in selecting the best courses of action for the 
42 situations and 11.5 for selecting the worst courses of action. 
Those whose total scores were above average were more con- 
sistent in their responses than those below average in total 
score. This method of investigation is laborious but tells 
something about test performance that no other statistical 
measure tells. 

For ages 15, 16 and 17 at which 73 per cent of the cases fell 
there was a consistent increase in Tact Test score with age. 
There were decided sex differences in Tact Test scores in favor 
of the girls at every age level. This difference in favor of the 
girls is the reverse of what is true for scores on Link’s Inven- 
tory of Activities and Interests (4). 

There were rather pronounced differences in average score 
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for the five schools cooperating. The boarding school was 
superior to all the rural high schools. 

The coefficient of correlation between Tact Test scores and 
teachers’ ratings was .28 + .06, or .33 + .06 when corrected 
for attenuation. The correlation between Tact Test scores 
and pupils’ ratings of each other was .20 + .06. A low corre- 
lation is to be expected, especially between Tact Test scores and 
ratings by pupils, for the pupils were not asked to rate each 
other in any particular trait. Even these low correlations, 
when based on one hundred cases in five different schools, sup- 
port the conclusion that there is a definite relationship between 
an adolescent’s rating by his associates and his ability to solve 
difficult social situations, verbally presented. 

The correlation between Tact Test score and IQ is .45 + .07. 
Although a correlation of this size indicates a definite relation- 
ship between the two abilities, it also indicates that there must 
be factors besides intelligence involved in the solution of dif- 
ficult social situations. The definition of intelligence as the 
ability to meet new situations (7) leads one to expect a definite 
relationship between intelligence test scores and ability to 
solve social situations. Factors such as learning from social 
experience may be required in addition to intelligence. 


SUMMARY 


The purpose of this study was to examine some of the as- 
pects and concomitants of social adaptability among adoles- 
cents. The subjects of the study were one hundred in num- 
ber. A group of twenty boys and girls was used in each of 
four rural consolidated high schools and in one boarding 
school. The following measures were obtained for the sub- 
jects: (1) rating in adaptability by teachers; (2) rating by 
fellow pupils; (3) intelligence quotient; and (4) ability to 
select the best courses of action in difficult social situations, 
verbally presented. 

The ratings by teachers were done by the paired-comparison 
method which proved quite satisfactory from several consid- 
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erations. The coefficient of reliability of the ratings was .96 
+ .01. A measure of the amount of disagreement among the 
raters was computed. In addition the eccentricity or peculiar- 
ity of certain raters was studied. 

Ratings by pupils were secured by asking them to choose 
companions for a trip. Teachers and pupils were in remark- 
ably close agreement in their ratings. The coefficient of 
correlation between ratings by teachers and ratings by pupils 
was .69 + .04. 

Intelligence test results showed that the raters were not 
unduly influenced by a consideration of the pupils’ intelli- 
gence. The coefficient of correlation between ratings by 
teachers and IQ was .37 + .07. 

Difficult social situations were solicited from a hundred 
college students. Solutions to these situations were suggested 
by fifty high school seniors. From these sources, forty-two 
situations, each with four solutions, were presented to high 
school students in an attempt to measure ability to select the 
best course of action in difficult social situations. For con- 
venience, this collection of situations and courses of action was 
called a Tact Test. It is apparent that the value of these situ- 
ations as measuring devices is limited by ‘the fact that they 
are verbal rather than behavioral. One who can select the best 
course of action, however, would seem more likely to follow it 
than one who cannot make the correct choice. A key for the 
Tact Test was constructed from ‘‘expert’’ opinion. 

The Tact Test was administered to the five groups included 
in the study and was repeated ten days later in four of the 
groups. The coefficient of reliability of the test is .74 + .03. 
A measure of the consistency of response was computed. This 
procedure revealed that those whose total scores are above 
average are more consistent (change their responses less from 
the first to the second test) than those whose scores are below 
average. 

There seems to be a consistent increase in Tact Test score 
with age and the girls are superior to boys at every age level. 
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The following correlations were found between Tact Test 
scores and other variables: 





r+P FE. 
Tact Test and Teachers’ Ratings ..................... 33 + .06 
Tact Test and Pupils’ Ratings 0.0.0.0... .20 + .06 
Tact Test and IQ 45 + .07 


CONCLUSIONS 


Conclusions from an investigation as limited as this one 
are no more than statements of the general conditions and 
facts found to be true in the groups and by the methods used 
in the particular study. 

1. The paired comparison method of rating pupils is highly 
reliable and practicable with groups of twenty. 

2. A measure of the amount of agreement among the raters 
is a meaningful supplement to the coefficient of reliability of 
ratings. In the present study there was greater agreement on 
the lowest students than on the highest, and greater agreement 
in picking those on the extremes than in picking those near the 
average. 

3. An analysis of disagreement among raters indicates that 
certain teachers are eccentric in their ratings of pupils. Other 
teachers agree very closely with the pupils’ average ratings. 

4. There is a low positive relationship between an adoles- 
cent’s rating by his associates and his ability to solve difficult 
social situations, verbally presented. 

5. Pupils and teachers agree quite closely in tke ratings 
which they assign to other pupils. 

6. In rating social traits teachers are not markedly influ- 
enced by the intelligence of the pupil. 

7. A measure of the consistency of response between a test 
and the re-test is a useful supplement to the coefficient of 
reliability. 

8. Ability to select the best course of action in difficult social 
situations was found to increase with age. Girls excelled boys 
at every age levei. 
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9. There are factors other than abstract intelligence that are 
important in solving difficult social situations. What these 
factors may be was one of several problems suggested by this 
investigation. 

Among the many questions raised by the present investiga- 
tion the following ones seem worthy of careful consideration: 

1. What tendencies toward uniformity of response result 
from the conditions of boarding-school life? 

2. Are there bona fide sex differences in tactfulness? 

3. How consistently are individual items of personality and 
social intelligence tests answered? If a group takes the same 
test on two different occasions how many item responses will 
be the same on the second test as on the first? 
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THE AGREEMENT OF KUHLMANN-BINET 
AND STANFORD-BINET RATINGS 
FOR 200 CASES 


GRACE ARTHUR 
Amherst H. Wilder Child Guidance Clinic, St. Paul, Minnesota 


N studies of the development of children comprising specific 
groups, it is often more practicable to assemble data that are 
available in the records of various agencies than to start to 

collect fresh data with a given problem in mind over a long 
period of time. 

It has often been found, in gathering data from several 
sources, that intelligence ratings have been obtained with differ- 
ent revisions of the Binet-Simon scale. The question then 
arises as to whether these ratings are comparable. As the 
Kuhlmann-Binet and the Stanford-Binet scales have been most 
frequently represented, the present report deals with ratings 
obtained with these two scales. 

The ratings used for comparison have been obtained by the 
Division of Research of the State Board of Control of Min- 
nesota, the Special Class Office of the Public Schools of Saint 
Paul, and the Child Guidance Clinic. There are 155 cases that 
were tested first with the Kuhlmann-Binet and later with the 
Stanford-Binet scale, and 45 cases that were tested first with 
the Stanford-Binet and later with the Kuhlmann-Binet scale. 
The Clinic custom of testing children with the Kuhlmann-Binet 
scale when a mental age of less than seven is anticipated has 
contributed to the larger number of cases in the first group. 
Many children had had several tests with the Kuhlmann-Binet 
before a Stanford-Binet test was given. In these cases the 
Kuhlmann-Binet rating obtained on the date nearest to the 
time of the giving of the Stanford-Binet test has been the one 
used for the present comparison. 

For the 155 cases for which the Kuhlmann-Binet rating had 
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been obtained first, the range in chronological age at the time 
of the first examination is from 3 years 3 months to 19 years 6 
months. The median chronological age at the time of the first 
examination was 9 years 2 months (Q: 7 years 3 months, Q. 9 
years 2 months, Q; 11 years 6 months). 

For this group the Kuhlmann-Binet IQ’s ranged from 53 to 
172, with a median of 86 (Q, 80, Q. 86, Q; 99). 

The interval between the giving of the. Kuhlmann-Binet and 
the giving of the Stanford-Binet scale ranged from 0 days, for 
the one child to whom the two scales had been given in immedi- 
ate succession, to 11 years 3 months. The median interval 
between the giving of the two scales was 2 years 0 months (Q, 
1 year 0 months, Q. 2 years 0 months, Q; 3 years 3 months). 

The change in IQ between the Kuhlmann-Binet and the 
Stanford-Binet ratings ranged from a gain of 22 points to a 
loss of 53 points of IQ. Arranged in algebraic order of mag- 
nitude they show a median difference of + 2: that is, the middle 
ease shows a gain of 2 points of IQ on the Stanford-Binet test 
(Q, —2, Q. +2, Q; +5). Disregarding signs, the median dif- 
ference is 3 points of IQ between Kuhlmann-Binet test and 
Stanford-Binet retest. 

As Heinis' has demonstrated that intelligence quotients vary 
with the passing of time in definitely predictable fashion, the 
ratings were all changed into terms of his Personal Constant 
by reading from tables compiled by Hilden.? We find that this 
method of holding the time interval constant between test and 
retest, greatly reduces the variability for the extreme cases of 
difference. In terms of Personal Constant the range of differ- 
ence between the Kuhlmann-Binet rating and the Stanford- 
Binet rating is from a gain of 13 PC units to a loss of 11 PC 
units. With values arranged in algebraic order, the median 
change is a gain of 1 PC unit (Q, —1, Q. +1, Q; +3). Disre- 

1 Heinis, H. ‘‘A Personal Constant,’’ Journal Educational Psychology, 
17, 163-186, 1926. 


2 Hilden, A. H. Table of Percent of Average Development Based on 
Mental Growth Units, Educational Test Bureau, Minneapolis, Minn. 
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garding signs, the median difference in rating between the 
Kuhlmann-Binet test and the Stanford-Binet retest is 2 PC 
units. 

For the 45 cases for which Stanford-Binet ratings were 
obtained first and the Kuhlmann-Binet later, there is a range 
in chronological age from 5 years 7 months to 17 years 10 
months, with a median of 13 years 2 months (Q,; 10 years 2 
months, Q. 13 years 2 months, Q; 15 years 3 months). 

The range in IQ on the first test, the Stanford-Binet, was 
from 20 to 156, with a median IQ 68 (Q; IQ 59, Q, IQ 68, Q; 
IQ 86). 

The interval between the giving of the Stanford-Binet and 
the giving of the Kuhlmann-Binet test ranged from 2 days, to 
4 years and 4 months (Q,; 7 months, Q. 2 years 1 month, Q; 2 
years 11 months). 

The change in IQ between the Stanford-Binet test and the 
Kuhlmann-Binet retest ranged from a gain of 12 points to a 
loss of 35 points of IQ with a median of + 0 (Q; —3, Q. + 0, 
Q; +3). Disregarding algebraic signs, the median difference 
between test and retest was 3 points of IQ, the same as that 
found for the larger group. 

These ratings, like those for the other group, were changed 
into terms of Heinis Personal Constant by reading from table. 
In terms of Personal Constant the change in rating between the 
Stanford-Binet test and the Kuhlmann-Binet retest showed a 
range from +7 to —12 PC units, with a median of +0 (Q, 
—2,Q. + 0,Q;+3). Disregarding signs, the median difference 
between the two sets of ratings in terms of Personal Constant 
is 2 PC units. 


CONCLUSION 


For the 200 cases included in this study, we find as great or 
greater agreement between test and retest when one is given 
with the Kuhlmann-Binet and the other with the Stanford-Binet 
scale as Terman reports for the Stanford-Binet when both test 
and retest are given with that scale. There is a slight tendency 
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for the Stanford-Binet ratings to run somewhat higher than 
those obtained with the Kuhlmann-Binet scale: 2 points of IQ 
or 1 PC unit for the group of 155 cases to which the Kuhlmann- 
Binet was given first. This tendency is not shown by the group 
of 45 cases to which the Stanford-Binet was given first. 

For both groups the median difference between test and 
retest was 3 points of IQ, and 2 PC units when ratings were 
changed into terms of Heinis Personal Constant. 














DISCUSSION OF ‘‘A STATISTICAL ANALYSIS 
OF THE HUMM-WADSWORTH TEM- 
PERAMENT SCALE”’ 


DONCASTER G. HUMM 
Los Angeles, California 


RECENT article’ by Barbara L. Kruger presents her 
analysis of the interrelationships which exist among 
the components of temperament as measured by the 

Humm-Wadsworth Temperament Scale. Some of the conclu- 
sions of that article appear to be open to question. 

Probably the most questionable point arises out of the draw- 
ing of conclusions from the study of a group which in prob- 
ability does not represent a random selection. Kruger takes 
her cases exclusively from the Adult Counseling Service of the 
Los Angeles City Schools, admits that it probably does not repre- 
sent a more heterogeneous group, yet draws unqualified 
conclusions in her summary. 

A second point has to do with the use of simple correlation 
in determining relationship between the components. In- 
spection of her Table III reveals marked skew in the distribu- 
tion of several components. Since such skew is very likely 
to result in curvilinear regression between components, con- 
clusions should not be drawn from the data until rectilinearity 
is established or such treatment of the data is made that pro- 
cedures which assume rectilinearity may validly be employed. 

A third point arises out of her comparison of the correla- 
tions obtained by her study with those reported in the stand- 
ardization? study of the scale. She compares correlations be- 
tween scores in several components by individuals with corre- 

1 Kruger, B. L.; A Statistical Analysis of the Humm-Wadsworth Tem- 
perament Scale; The Journal of Applied Psychol.; XXII, 6. 


2Humm, D. G., and Wadsworth, G. W., Jr.; The Humm-Wadsworth 
Temperament Scale; Amer. Jour. of Psychiatry; 92; 1. 
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lations between several groups of subjects by answer in the 
affirmative to questions. Furthermore, the individuals of her 
group are drawn from one group only, while in the standard- 
ization study there were fourteen specially selected groups. 

A fourth point arises out of her inclusion of cases which, by 
the scoring procedures developed in the standardization, should 
be considered invalid. The inclusion of such cases has a valid 
statistical probabuity of including findings contrary to fact. 

A fifth point is her error in assuming that an application of 
partial correlation technique would not materially change her 
findings. The very fact that her correlations extend over a 
much wider range is in itself predictive that partial correla- 
tions of the fifth or sixth order would vary greater than those 
found in the standardization study. However, it would not 
be possible to use partial correlation techniques until recti- 
linearity was established. 

A study of the scale has recently been completed® in which 
partial and multiple correlation and regression techniques 
were extensively used. The raw correlations obtained in that 
study from a consideration of all cases, both valid and invalid, 
do not vary widely from those obtained in the Kruger study. 
The partial regressions of the sixth order, however, are in 
sharp contrast. 

In the light of these five points it seems to have been a mis- 
take to designate this study a statistical analysis of the scale. 
For such a purpose the sampling was not adequate, criteria 
were not set up, and the mathematical treatment was neither 
sound nor sufficiently extensive. 

3 Humm, D. G., Storment, R. C., and Iorns, M. E.; Combination Scores 


for the Humm-Wadsworth Temperament Scale; The Journal of Psychol- 
ogy; 1939; 7. 




















PSYCHOLOGICAL RATING OF UNIVERSITY 
OF PITTSBURGH HONOR GRADUATES 


OMAR C. HELD 
University of Pittsburgh 


HE University of Pittsburgh awards three types of academic honors 
to graduating seniors, namely, highest honors, high honors, and 
honors. 

The American Council on Education Psychological Examination is given 
to all entering freshmen with the exception of those entering the Schools 
of Engineering and Mines. 

All students who graduated with highest honors, high honors, or honors 
from August, 1933, to June, 1937, were selected for this study and their 
respective centile ranks on the American Council on Education Psychologi- 
eal Examination at the time they were admitted to the University was 
recorded. Table 1 summarizes the data. 


TABLE 1 


Centile Ranks of Students in the Three Honor Groups Graduated from the 
University of Pittsburgh from August, 1933, to June, 1937 

















Centile ranks 
Groups No. 
Range Mean Median 
Highest Bomor cc ccccccsceesnne 25 61-100 90.64 95 
High honor 29 61-100 85.62 91 
Honor 62 18-100 79.11 84 
Combined honor groups .......... 116 18-100 82.10 89 





There were five who graduated with highest honors for whom psycho- 
logical ratings were not available. Seventeen high honors graduates and 
twenty-seven honors graduates did not take the Psychological Examina- 
tion. These students were not included in the table. 

Six students who graduated with honors ranked below the fiftieth cen- 
tile of the freshman class with whom they entered the University, but only 
one was very far below this point. 

It is interesting to note that one student who rated at the eighteenth 
centile on the Psychological Examination graduated with honors. The 
head of this student’s division reports that this student is emotionally 
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unstable and was probably considerably upset by the strain of taking the 
test, which may in part explain his poor test performance. The head of 
the division also reports that this student is pleasant, ingratiating, and 
has mastered the technique of pleasing teachers and getting good grades. 

The mean and median of the centile ranks of all the honors students 
here considered indicates a close relationship between test performance 
and scholarship. While the psychological examination does not measure 
all the attributes necessary for doing superior scholastic work, it does seem 
to measure some very important ones. 

These honors students have not only maintained high scholastic averages 
but have also been the leaders in extra curricular activities. They have 
been active in publications, debate, dramatics, social fraternities, mortar 
board, student government, Reserve Officers Training Corps, departmental 
honorary groups, glee club, and in the band. They have not been active 
in sports except in a managerial capacity. 

There are some students who do well on the psychological test but do not 
graduate with honors. In some instances this fact is accounted for by 
lack of proper motivation, excessive outside work, health and personality 
factors, which are not measured by the psychological examination. 

In most instances with the data which the personnel office has available 
it is possible to predict in a high percentage of instances, which students 
will graduate with honors and achieve the positions of honor and trust in 
non-athletic activities. 








NOTE ON CALCULATING THE STANDARD 
ERROR OF MEASUREMENT AND RE- 
LIABILITY COEFFICIENTS WITH 
THE TEST-SCORING MACHINE 


JOHN C. FLANAGAN 
Cooperative Test Service of the American Council on Education 


It has been noted by Dr. Phillip J. Rulon that when using odd and 
even scores to study the consistency of a test, the standard deviation of 
the differences between the odd and even scores is precisely equal to the 
standard error of measurement of the scores in that group. 

The flexibility of the International test-scoring machine is well illus- 
trated by the fact that one can prepare a stencil which will yield auto- 
matically, in a single reading, a score which is precisely the difference 
between the scores on the odd and even items. This is done by reversing 
the roles of rights and wrongs on half of the items, for example, the even 
items, and scoring the right answers as wrong and the wrong answers as 
right for these items.2 

If a reliability coefficient is preferred, this is given by the formula 


2 
rm =1-55, where op? is the variance of the difference scores and o,? 
is the variance of the ordinary test scores including both odds and evens. 


1 Rulon, Phillip J., A Simplified Procedure for Determining the Relia- 
bility of a Test by Split-Halves, Harvard Educational Review, 9, 1939, 
99-103. 

2 This procedure holds only where the scoring formula is rights minus 
wrongs, or where the odd and even scores are merely the numbers of items 
correct. It should be noted that the method can easily be generalized to 
obtain the intercorrelations between parts of tests or tests, the responses 
to which are recorded on the same side of an answer sheet. 
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NEWS AND NOTES 


A preliminary announcement has been received of the Twelfth Inter- 
national Congress of Psychology, to be held in Edinburgh, Scotland, from 
July 22 to 27th, 1940. The Right Honorable Mr. John Colville, Secre- 
tary of State for Scotland, has accepted the Honorary Presidency of the 
Congress. Those who desire full information concerning the meetings of 
the Congress are advised to communicate as early as possible with Dr. 
Godfrey Thomson, General Secretary, Moray House, Edinburgh 8, Scot- 
land. 


Dr. Christian A. Ruckmick, formerly professor of psychology at the 
University of Iowa, is now associated with the C. H. Stoelting Company 
of Chicago, for fifty-three years manufacturers of and dealers in psycho- 
logical and physiological apparatus and supplies. He has been appointed 
to the position of secretary and general sales manager. 


The University of Chicago and Columbia Broadcasting System are col- 
laborating in a new and experimental type of educational program. 
Under the title of The Human .\dventure, the first of a limited series 
of programs was presented July 25, 8: 00 to 9: 00 P.M., E.D.8.T., over 
the Columbia Network. The Human Adventure is experimental because 
it attempts to adapt the appeal of commercial programs to educational 
radio; it hopes to interpret the function of American universities to a 
wide audience; it hopes also to entertain and to educate the public. 


Advance notice has been received of the Eighth Educational Conference 
which will be held at the Hotel Roosevelt, New York City, on October 26 
and 27, 1939. It is being sponsored by the Educational Records Bureau, 
the Cooperative Test Service, the Committee on Measurement and Gui- 
dance of the American Council on Education, and the Commission on the 
Relation of School and College of the Progressive Education Association. 
The meetings will be open to all educators, whether or not they hold mem- 
bership in the sponsoring organizations. Reservations should be made in 
advance through the Educational Records Bureau, 437 West 59th Street, 
New York City. Among the speakers will appear President Henry M. 
Wriston of Brown University; President Marion Park of Bryn Mawr 
College; Superintendent A. J. Stoddard of Philadelphia, and many other 
outstanding educators. 


An interesting piece of research will be undertaken this summer and 
fall by Dr. George S. Snoddy of the Indiana University Psychology De- 
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partment. He will attempt to learn to what extent people have forgotten 
a learning activity after a lapse of twenty years. He will use the same 
group of persons as subjects as he used twenty years ago and will do his 
research work at the University of Utah where he taught for ten years 
prior to coming to Indiana University in 1925. The group when tested 
originally by Dr. Snoddy included some 300 sophomores and juniors at 
the University of Utah. An opportunity to test the same group so many 
years later is extremely rare, but due to the fact that Salt Lake City is 
the heart of Mormon activities and since the majority of the group are 
Mormons, they settled within a small radius of Salt Lake City after leav- 
ing college. Dr. Snoddy is of the opinion that the subjects will have 
forgotten very little and will reach their former levels in a short time. 


The Test Scoring Machine Department of the International Business 
Machines Corporation reports several new tests adap*<:: for machine scor- 
ing, among which is the Iowa State Multi-Attitude Secale, by Dr. A. R. 
Lauer, for measuring certain attitudes relating to automobile driving. 
Forms now available or in preparation include: A. Traffic law, tolerance, 
risk; B. Honesty, superstition, people; C. Study and scholastic interests; 
D. Safety, employability, cooperativeness; E. Religious tolerance, charity, 
breadth of view. These tests are published by Carter Press, Test Division, 
Ames, Iowa. 

The Preference Record, by G. Frederic Kuder, is available in machine- 
scored form and can be scored for the following types of activity: Scien- 
tific, Computational, Musical, Artistic, Literary, Social Service, and Per- 
suasive. The scores have low intercorrelations in randomly selected col- 
lege groups. 

The progress test program at the University of Florida serves several 
purposes. The objective achievement tests given regularly in each of the 
comprehensive courses at intervals varying from two to six weeks provide 
the student with a periodic opportunity to check on his own progress, and 
the Dean with a cumulative record of the achievement and endeavor of 
every student. Study of the test items provides the instructional staff 
with a similar check-up on their success in establishing basic concepts, 
while at the same time adding to the library of pre-tested examination 
items. A further function is to familiarize the students with the type of 
test used so that the final comprehensive is freed of errors due to un- 
familiarity with objective examinations. Tests in ‘‘Man and the Physi- 
eal World’’ and ‘‘General Mathematics’’ are given every two weeks. 
The tests are given on Saturday, scored by the Test Scoring Machine, and 
returned to the students on the following Tuesday. Tests in other courses 
are given at four- to six-week intervals. 
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Lewin Kurt: The Conceptual Representation and the Measurement of 
Psychological Forces. Contributions to Psychological Theory, 1938, 


vol. 1, No. 4, Durham, North Carolina. Duke University Press, pp. 
247. $2.00. 


This monograph is a further step in the development of Lewin’s elabo- 
rate theoretical system—an introduction to a ‘‘veetor’’ psychology, con- 
cerned with the dynamics of behavior, and intimately related to the prin- 
ciples of topological psychology previously described by the author. The 
principal purpose here is the discussion of one of the fundamental prob- 
lems of psychological dynamics—namely, the problem of representing 
psychological forces conceptually. In no sense should this monograph be 
considered a textbook of experimental research. Rather it is to be re- 
garded as an all too rare example of a positive, sophisticated contribution 
to the frame work of a theoretical psychology, far above the textbook 
level. The general function of such a theoretical system is in the reformu- 
lation and reorientation of concrete psychological problems. 

The first part of the monograph deals with the place of the construct 
‘‘foree’’ in psychology, and with the geometry of direction of paths in 
hodological space. Psychological direction, which is one of the significant 
properties of force, is determinable not in terms of Euclidean geometry, 
but in terms of the geometry of hodological space. Psychological exam- 
ples illustrating the application of hodologicai space in the determination 
of distance and direction are given in some detail. The second part of 
the monograph is devoted to a discussion of certain basic conceptual and 
dynamic relations between force, tension and valence. Various methods 
of measuring forces and valences are analyzed, especially those related 
to opposing forces and to the velocity of restlessness, consumption, trans- 
location and learning. The problem of the structure of the force field, 
including choice and conflict situations with stabile and labile equilibria, 
is discussed, mainly with reference to the relatively simple problems of 
driving and restraining forces. 

At the outset the reader may be disconcerted by Lewin’s extensive use 
of symbolization in the representation of forces. In fact, the complexity 
is only apparent, and the reader will find that in the beginning a little 
judicious study of the various symbols employed will greatly aid his read- 
ing. Moreover, the appended glossary should be of help in this direction, 
as it presents a condensed summary of the definitions, basic formulae, and 
examples discussed in the text in connection with the geometry and dynam- 
ies of the life space. At times the exactitude of the symbelization may 
seem to imply a degree of precision in the theory not at all justified by 
the factual content. Clearly this has not been the intent of the author. 
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The intricate theoretical framework of Lewin’s system is admittedly 
incomplete. It will require constant amplification and revision as experi- 
mental research continues. In many places the logical connections in the 
theory are not clear, and the assumptions unsupported. In certain critical 
areas the discussion is unexpectedly deficient. In particular, it seems to 
the reviewer that the problem of psychological distance has been very 
inadequately treated. Distance operates as an essential factor in the 
fundamental relationship between force, and valence and distance to the 
goal; yet it is not made clear just how distance is to be defined and 
measured. 

It is only fair to note that Lewin has been the first to recognize these 
and other limitations of his theory in its present form. This monograph 
is not in the least intended as a final statement of a theoretical povition, 
but in large part as a necessary indicator of the direction of further 
research and further development of theory. Most characteristically it 
is provocative of critical new experimental problems, hitherto unperceived, 
which become apparent when old facts are reoriented in new theoretical 
structures. 

No extensive critical review of Lewin’s system is appropriate here. To 
the reviewer it seems that the ultimate value of that which Lewin is at- 
tempting in this monograph can best be judged in terms of the importance 
of work which it stimulates. 

RicHarD 8. CRUTCHFIELD, 
Mount Holyoke College 


James H. Beprorp. Youth and the world’s work. Los Angeles, Calif., 
Society for Occupational Research, Ltd., 1938. Pp. viii+ 140. 


Unemployment in an industrial culture is a major problem at any time, 
but it has been especially so for the past ten years, during which several 
millions of youth have finished school and have been entirely unable to 
find jobs. Dr. Bedford realizes that this circumstance is, in large measure, 
due to a ‘‘profit-motive’’ economic system. However, he places a large 
share of the blame, if it can be so called, on the public school system, 
especially at the secondary level. 

The empirical basis for his argument rests upon the analysis of data 
concerning the vocational choices of 1,211 students of typical California 
high schools. These data indicate, as have other studies, that high school 
students in large measure select ‘‘white-collar’’ jobs in spite of the fact 
that our society can use only a limited number of persons in such occupa- 
tions. That the students’ selections are made largely on irrational bases 
is shown by the found lack of correlation between their choices and their 
knowledge, through experience or school training, of the occupations. 
This lack of knowledge is itself fostered by the high schools which adhere 
to a traditional curriculum, heavily weighted with a cultural aim, when 
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society demands a more vocational emphasis. Instead of being progres- 
sive the schools are reactionary in their acceptance of the status quo. 
Dr. Bedford is not offering a panacea for our economic ills. He does 
believe, and with good justification, that a modified curriculum closely 
integrated with an intelligent guidance program would add a very impor- 
tant small measure to the solution of our industrial problems. This is an 
important monograph for all secondary school people; among psycholo- 
gists it will be read with profit by all those interested in the guidance of 
adolescents. 
C. M. Lourrit, 
Indiana University 


Fioyp Harbin, EuLALIA CHAPMAN, and LerHa Hitt. Child psychology. 
An annotated bibliography. Denver, Colo., Bibliographical Center 
for Research. 1938. (Hectographed without pagination.) 

This is a useful bibliography with 640 entries representing approxi- 
mately 500 books and monographs classified under the subject headings 
——child study, children—abnormal and backward, children—manage- 
ment, education of children, juvenile delinquency, and parent and child. 
For each title is given the complete reference, an annotation usually taken 
from a published review of the book, a brief list of other published reviews, 
and a finding list of holdings of important libraries in the Rocky Moun- 
tain region. 

The compilers limited themselves to books in English for which authori- 
tative reviews could be found. While the list probably includes all of the 
major and important books there is some question of completeness. For 
example several very specialized monographs are listed but many are not. 
As the preface disclaims any effort at completeness this may be excused. 
However, there are certain inconsistencies which are bibliographically inex- 
cusable. Noteworthy among these are failure to list reviews in journals 
which the evidence shows were searched, failure to consistently give the 
author of reviews when it was given in the published review, and failure 
to note the latest edition of important books, ¢e.g., Terman and Merrill, 
and Strang, which had been reviewed before the date of the bibliography. 
In spite of these defects this bibliography should prove valuable to child 
psychologists, and especially so to those working in the Rocky Mountain 
region. 

C. M. Lourtir, 
Indiana Uniwersity 


C. Lanpis and W. Hunt. The Startle Pattern. Farrar & Rinehart, 
N. Y., 1939, pp. 163, $2.50. 


Here one finds a very interesting portrait of this newly found unit of 
behavior. The account is quite complete giving a description of the prob- 
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lem involved, the method and the modifications in technique, the findings 
for each type of subject, even separate subjects, where all members of 
one type do not respond the same. 

The book is well organized and easy to read since each chapter gives a 
complete picture. The authors have selected their subjects in a way that 
attempts to answer the question of how the startle pattern varies in differ- 
ent kinds of personalities. Thus, one sees the effect in trained marksmen, 
normal subjects in many conditions, infants and children, animals, psy- 
chotics and aments, epileptics, deaf, adrenalized and hypnotized subjects, 
all in a way that makes comparison easy. 

Dr. Hans Strauss collaborates by giving a description of the nervous 
mechanism underlying this response. In doing this he separates the 
startle pattern into (1) the postural elements, and (2) the eye-blink re- 
sponse and finds evidence that these are based upon separate reflex ares. 
This part is rather technical and therefore is of doubtful benefit to the 
student who hasn’t complete knowledge of the anatomy of the brain. 

A chapter devoted to secondary behavior, that which follows the startle 
pattern in time, shows that this is much more variable and more difficult 
to describe than is the startle pattern itself. This behavior also varies 
with different types of subjects. 

There is a summarizing chapter in which the authors discuss the rela- 
tionship of their findings to current points of view about the nature of 
emotions and this should be of wide interest to those in academic psychol- 
ogy. On the whole the book is good and, for anyone doing research in 
emotions, it is valuable. Certainly the technique used here is worth pur- 
suing as a research tool and, if results continue to be as consistent as these 
workers have found, it will be very valuable diagnostically. 

Seventy-nine references are given. 


K. W. OBERLIN, 
University of Delaware 








NEW BOOKS AND PAMPHLETS 


New books and pamplets to be reviewed should be sent to James P. 
Porter, Editor, JOURNAL OF APPLIED PsycHoLogy, Ohio University, 
Athens, Ohio. 

Air-War. W.O’D. Pierce. Modern Age Books, Inc., New York, 1937. 
224 pp. 

The Art of Being a Person. Grorce Ross Wetis. D. Appleton-Century 
Company, New York, 1939. $2.50. 300 pp. 

General Psychology. LawkENcE E. Cott. McGraw-Hill Book Company, 
New York, 1939. $3.50. 688 pp. 

General Psychology (revised). WAYLAND F. VauGHaNn. Doubleday, 
Doran & Company, New York, 1939. $3.00. 745 pp. 

How to Counsel Students. E.G. WimLuiaMson. McGraw-Hill Company, 
New York, 1939. $3.00. 562 pp. 

Human Development and Learning. Frank 8. Satispury. McGraw-Hill 
Book Company, New York, 1939. $3.00. 513 pp. 

Life: A Psychological Survey. Simpney L. Pressey, J. EvLiorr JANNEY 
and RayMonp G. KunLEN. Harper & Brothers, New York, 1939. 
$2.50. 654 pp. 

Mastering Your Nerves. Peter Fietcuer. £. P. Dutton & Company, 
New York, 1939. $1.50. 241 pp. 

Measurement of Adult Intelligence. Davin WECHSLER. Williams & Wil- 
kins Company, Baltimore, Md., 1939. $3.50. 227 pp. 

Mental Hygiene. WitL1aM Henry MIKESELL. Prentice-Hall, New York, 
1939. $2.50. 456 pp. 

Sleep and Wakefulness. NATHANIEL KLEITMAN. University of Chicago 
Press, Chicago, 1939. $5.00. 638 pp. 

Tests of Mental Development: Manual. F. KUHLMANN. Educational 
Test Bureau. Educational Publishers, Inc., Minneapolis, Nashville, 
Philadelphia. 

The American Management Association, 330 West 42nd Street, New York, 
has published the following Office Management Series, Nos. 82, 83, 84 
and 85 respectively: Time and Motion Economy in the Office. JOHN 
T. SmuvKEy and ALLAN H. MoGENsEN. Modern Office Management 
Methods. JouN MITCHELL, Evcene J. Benoz, V. J. Ovearo, J. J. 
SmirH, and L. Urwick. Office Personnel Administration. E. D. 
BarRTLeTt, Ricnarp 8, ScuvuttTz, Joun A. WiiuiaMs, A. L. Kress, 
E. B. Roperts, and R. L. Hutt. Efficiency and Economy in Office 
Procedures. W.E. Tarr, W. F. Titus, Morton P. Francis, Orrin 
G. SHerMan, C. L. Stivers, and J. H. MacDonatp. 
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